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ABSTRACT 

This technical report describes the evaluation of the 
first year of Project Upswing, a 2-year experimental study to 
determine the potential contribution of volunteers in helping young 
children overcome learning difficulties. The three large groups of 
first grade children involved received tutoring either from specially 
trained volunteers, untrained volunteers, or received, no tutoring as 
a control group. Results indicated that children taught by either the 
trained or untrained tutors made greater gains in achievement than 
the control children. Tutored children also showed gains in 
self-esteem. Volume I of this report includes profiles of 
participants and their first impressions of the project. Volume II 
provides an analysis of tutoring results and final impressions of the 
project. An appendix gjJves facsimiles of evaluation questionnaires. 
(CS) 
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FOREWORD 

\ 

I 



The first volume of the final evaluative report on Project Upswing's 
first year is primarily descriptive'. It presents characteristics of the major 
groups of people involved (children, volunteers, and teachers) along with 
attitudes toward the project in its early stages. The Upswing ''pre -tutoring" 
test battery also is described and the test results subjected to preliminary 
analysis. The examination of pri)ject effects, using final (end-of-/ear) test 
results and attitudes, are preseJted against this background in Volume II of 
the report. 

Volume I was written during the course of the first year of the project. 
The present-tense description has not been changed. The opinions expressed 
in this report are those of Operations Research, Inc. They do not necessarily 
reflect the opinions of the U.S. Office of Education. 
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SUMMARY OF THE EVALUATION FINDINGS 



BACKGROUND 
Organization 

Project Upswing is a 2-year experimental study to determine what 
contribution volunteers can make in helping very young children overcome 
learning difficulties before they. become serious impediments to a success- 
ful school experience. This report describes the evaluation of the first year 
of Upswing, 

The project was conducted in the 1972-73 school year in four cities: 
Denver; Oxford, Mississippi; St. Louis; and San Francisco. It was a joint 
enterprise of a university and the public school system in each city. The 
university managed project operations, monitored by the U.S. Office of 
Education, which provides the funds. 

A private research company —Operations Research, Inc.— was respon- 
sible for the analysis of project results. 

Major Groups of Participants 

When the project began it involved a total of 407 volunteers, 407 
children, and the 130 teachers of those children. These numbers were reduced 
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over the year, primarily by volunteer attrition. 

The children were selected by their teachers and randomly assigned 
to three equal size groups— one who would have trained volunteer tutors, 
one ^ho would have tutors who did not receive Upswing training, and a control 
group who would not be tutored. All groups were tested at the^beginning and 
end of the school year (see Volume I, Section 11, for description of the test 
battery). Analysis of the iiiitial test results verified that the random assign- 
ment yielded three groups of children comparable in.reading proficiency, 
visual-motor integration skills, and IQ. 

Most of the volunteers were married women with children, not employed 
outside the home, or college students • There were volunteers of all ages, 
although the population was slightly weighted with younger people. The vol- 
unteers were well educated and tended to have above-average family income. 
About oneTthird had some formal training in child development (usually a college 
course) before joining Project Upswing and about half had relevant experience 
as volunteer tutors, teacher aides or teachers. 

The two groups of voluuteers— those who received training and those 
who did not — were comparable in makeup in terms of income", education, 
experience, etc. The only meaningful difference was that the untrained group 
included more college student volunteers younger than 21. The analysis of 
what factors influenced tutoring results showed that none of the volunteer 
background characteristics was important, not even previous relevant training 
and experience. 

The teachers of the Upswing children were, as a group, relatively 
young (about 40% between 21 and 30 years old) . Almost all were college 
graduates, but only a small percentage had completed advanced degrees. 
Over half had some training in education of children with learning problems, 
generally in the form of graduate-level college courses. Most had been 
teaching for at least three years, but a sizable group were new at teaching 
first grade. Almost all teacher participants in Denver and San Francisco had 
worked with volunteers or paid aides before Upswing, and about two-thirds 
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of the Oxford teachers had such experience* Only about a thrid of the St. Louis 
teacher participants had worked with volunteers or aides before. 

EVALUATION FINDINGS 

Tutored Children Made Greater Gains in Reading Than the Control Group Children 

Statistical analysis of pre- and post-tutoring Wide Range Achievement 
Test (WRAT) results established that the groups of children tutored by trained 
and untrained Upswing volunteers made more progress in reading than did the 
control group of children who had similar learning-related characteristics at 
the beginning of the project but were not tutored. The amount of mean difference 
was not dramatic, but it was real. That is, the differences observed between 
the tutored and control children's changes in WRAT score statistically could not 
have occurred by chance. The tutored children showed a mean increase in 
WRAT standard score of 7.5 points. The control group mean change was four 
standard score points . 

The greater mean improvement in reading by the tutored children is 
important, although the difference is small, if the trend pe;sists over tim e. 
The tutored arid control cnildren are being followed for a second year and 
their relative levels of reading proficiency will be analyzed as part of the 
second-year Upswing evaluation. , 

Tutoring Helped the Children in Important Areas Other Than Reading 

Teachers and the volunteer tutors four^d that low self-esteem, was a 
major problem among the children who had Upswing tutors. The volunteers 
found that nearly all children who had low self-esteem improvad over the 
tutoring period, while teachers found that about two-thirds of the children with 
problems improved. The study hypothesis that gains in reading skills are 
accompanied by gains in self-esteem was supported by the analysis. 

Improved oral language skills also appear to be an important benefit 
of one-to-one tutoring. Both teachers and volunteers found about two-thirds 
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of the tutored children's oral skills underde\7eloped oi the beginning. The 
volunteers noted progress in almost all of the children who had this kind of 
difficulty; teachers n.jted improvement in about 70%. 

Gains in oral language skills were found to be related to gains in 
self-esteem. Gains in oral language and reading also occurred cogether. 

Hyperactivity and, more so, inability to "pay a^':ention" were 
common among the children tutored in Project Upsw^ig. Tutoring appears to 
have had some impact in alleviating these !:3r:;5 of problems; however, the 
gains here were not as great as in other areas. This outcome was as expected, 
since hyperactivity and distractibi l.cy are problems that often have physical 
origin. 

An interesting finding was that the children who made the greatest 
progress in reading commonly continued to have difficulty paying attention 
at the end of the year. It is probable that boredom affected children who had 
achieved reading competency. It also seems probable, from the incidence of 
attention problems reported and from the low "cure rate," that the adults may 
have exp: -^d more maturity in this atea than was appropriate and that the 
children were absorbing more thcin they appeared to be absorbing. 

Tutoring Did Not Help Children Improve Their Visual-Motor Coordination 

An objective test (the Beery-Buktenica Developmental Test of Visual- 
Motor Integration, known as the VMI) established that tutoring did not help 
the children improve therr visual-motor coordination. All groups of. children 
showed immaturity in this aspect of psychomotor development at the beginning 
of the tutoring period . The mean VMI performance of all groups of children 
was at about the level normally expected of Si-year olds. The children showed 
virtually no change on the final ^.^Ml test: neither tutoring nor simply growing 
older enhanced VMI skills. This suggests that specific instructional techniques 
are needed to correct such coordination problems. 
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Training Did Not Influence Volunteer Effectiveness in the First Year of Upswing 

Statistical tests showed that the training given in the first year of , 
Upswing did not make the volunteer tutors any more effective in improving 
children's reading skills. Nor were the trained and untrained volunteers' 
observations about the children's progress in other areas appreciably different. 
However, it appears that the training content and timing in the first year of 
Upswing were deficient. The second year of the project offers a charges to 
study the efficacy of revised training programs, aimed more toward individual 
needs and a greater variety of specific instructional techniques. More of the 
training will be given during the tutoring period in the second year; in the first 
year most of the training v/as pre service. 

The second-year evaluation will seek to test the first-year finding 
about the imibact of training. If this finding is supported with the various 
training strategies employed in the second year, then we will conclude that 
formal training is unnecessary in a tutoring project such as Upswing. With- 
out training, project costs would come down considerably. 

Processes Within the Child, Along With Volunteer Satisfaction and Confidence^ 
Proved to be Most Related Children's Progress in Reading 

As might be expected, knowledge of a great many variables is required 
to predict how reading '^' ills will develop. ORI collected data on 46 variables 
for the Upswing study. We found that 36 of these were related to change in 
reading test score. Individually, these variables are weak predictors. A 
cluster of conditions interact with each other and together influence reading 
proficiency . 

The most important factors seem to have been: changes in the child's 
self-esteem and ability to pay attention; volunteer's feelings about how ade- 
quately she/he was prepared to use methods and materials of tutoring; volun- 
teer*s willingness to tutor again; (an indicator of motivation) and whether the 
volunteer's expectations about the project were fulfilled (an indicator of role 
satisfaction). Again, these variables (and others) interact to influence 
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development of reading skills. The relationships are quite complex. No 
one or a few variables offer a key to reading success. 

Volunteers Prefer to Receive Training and Teachers Prefer to Work With Trained 
Volunteers 

Training did have an impact on the volunteers' and teachers' attitudes, 
even though it did not influence volunteer effectiveness. Both trained and un- 
trained tutors generally seemed to believe that training was important, and 
the untrained tended to show slightly less confidence in their ability 
to tutor. Teachers, as a group, clearly preferred to work with trained volun- 
teers, often because they felt the untrained lacked the skills to function , 
independently without considerable support, which the teachers indicated they 
did not have time to give. They tended to feel that the trained volunteers were 
better prepared to work as tutors. , 

Feelings about the importance of training may be especially strong in 
this project because half of the volunteers received training and half did not. 
Tnis would particularly affect the untrained volunteers, who often seemed to^^ 
feel the other group was "one up on them." It is likely that professionalism 
among teachers would cause them to value training highly. These feelings 
persisted despite the fact that, as far as the children were concerned, it made 
no difference whether the volunteers were trained or not. This kind of result 
points up the need for independent research. . 

T eachers Wanted to be Informed About the Activities of Upswing Tutors and to 
be Consulted, But They Did Not Want to be "Leaned On" 

Although teachers generally did not want to have to. tell the Upswing 
volunteers what to do, they did want to know what was being done. They were . 
most willing to take a consultative role, giving their views of their pupils' 
needs to the tutors and ensuring that classroom and tutoring instruction were 
complementary. Many stated that they wanted the volunteers to make their 
own plans for tutoring but also to be willing to devote sessions to teacher- 
requested activities. 

O xii 
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Volunteers Often Felt a Need for More Help Than They Received 

It appears from the Upswing experience that access to help, on 
specific problems as needed, may be more important than formal traini:ag 
tutoring program. Although trained volunteers showed more satisfoction 
with the amount of help received over the year than did untrained, a sizable 
proportion even of the trained group (about 40%) said they did not receive 
enough help. Over half of the untrained volunteers said they did not receive 
enough help. Generally they seemed to want advice — help in understanding 
their pupils' needs, in planning tutoring activities to address specific needs, 
and in evaluating progress. They did not seem to want highly directive 
assistance. 

Regardless of training, volunteers generally felt it was important 
to at least confer with thfeir pupils' teachers periodically. The idea of a 
volunteer tutor functioning completely independently of the teacher seems 
impractical . 

Providing Elaborate Tutoring Materials Seems Unnecessary 

The trained Upswing volunteers did not make good use of the packaged 
reading programs provided by the project. Both the trained cud untrained were 
eclectic in choosing tutoring method'^ and materials. They evidently would 
pr*^. ^r to have or to be informed about a variety of simpler materials. This 
finding has important cost implications. The cost of materials in a project 
like Upswing could be minimal without impairing ability to tutor. 
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I. INTRODUCTION 



SUMMARY OF PROJECT ORGANIZATION- 

Project Upswing is a pilot study, sponsored by the Bureau of Educa- 
tional Personnel Development (BEPD) , U.S. Office of Education (USOE) , 
designed to determine whether first grade children with minimal learning dif- 
ficulties can be aided by volunteer tutors . A major goal of the project is to 
see whether children receiving this personalized assistance make more pro- 
gress than a control group of children with similar problems who receive no 
volunteer a'id. A second major comparison is'^oetween children tutored by 
volunteers with no special training and children tutored by volunteers who have 
received training in learning problems often found in first grade children and 
the techniques for overcoming these problems. Half of the volunteers received 
a total of 40 hours of preservice and inservice instruction. The other half of 
the volunteers received no formal instruction beyond a 3- to 5-hour orienta- 
tion to the Upswing program. The volunteers in this second group were more 

—'^This material provides a framework for the remainder of the report. It is 
included as a convenience for the reader, although to some it may be 
repetitive. 
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dependent pn their own individual resources and the guidance of the classroom 

teacher than those in the trained group. Both trained and untrained volunteers 

tutored from November 1971, when the children were identified for the project, 

until the end of the 1971-72 school year. 

The project has been run as a cooperative effort between the university 

and the school system in four cities: Denver, Colorado; Oxford, Mississippi; 

2/ 

St. Louis, Missouri; and San Francisco, California.— The university depart- 
ment of special education holds the contract in all cases. Operations Research, 
Inc. (ORI) is serving as the outside evaluator of project effects, under 
separate contract. 

The research design called for operation in all cities on a cross sec- 
tion of schools selected to reflect, insofar as possible, the social, racial, 
and economic population of the city at large. Typically, this cross section 

included between 8 and 14 schools. Oxford, however, has only two elemen-^ . 

tary schools, one for each of the consolidated school districts in the area. 
Both were Upswing schools, and because of their size, Oxford had roughly 
the same number of Upswing children as the other cities. First grade teachers 
at the selected schools were asked to participate by their principals. 

Each city identified a group of approximately 150 children for the 
project. These children were divided on a completely random basis into three 
groups as equal in number as possible. One group was assigned to trained 
volunteers and one to untrained volunteers; the third, a control group, had no 
Upswing volunteer tutor. The project design called for children to be referred 
by their first grade teachers and then screened based on the results of a battery 
of tests covering IQ; reading, spelling, and arithmetic skills; level of 
visual-motor integration; behavior; and hearing and visual acuity. The tests 



Originally, Cincinnati, Ohio, was to have participated as well, but the 
project there was discontinued in the fall of 1971. (See Operations Research, 
Inc.'s first interim report on Project Upswing, TR 7G0, January 1972, Section 
IV.) 
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were given, but, in general, too late to be used for screening purposes; essen- 

3 

tially all teacher referrals were accepted (see Section II discussion of testing) 
Volunteers were recruited by the university project staffs, in cooper^- 
ation with the public school systems, in August and September ]971. A total 
of 100 volunteers were to be recruited in each city — 50 who would receive 
training and 50 who would not. Assignments to the trained or the untrained 
group were to be made by the city project staffs on a random basis. (The actual 
numbers of volunteers recruited in each city and their assignment to groups are 
discussed in Section III of this report.) 

PURPOSE AND CONTENT OF REPORT 

This report is part of the preparatory work of the evaluation of Project 
Upswing's effects in its first year of operation. The baselines for the: evalu- 
ation are established here, namely: 

• Learning characteristics of the Upswing children at 
the beginning of tutoring (results of IQ, achievement, 
and other tests given the children in the early stages 
of tutoring) 

• Background characteristics of the volunteer tutors 

• Background characteristics of the teachers involved 
in the project . 

The major points to be determined at this time are: 

• Whether the child population in fact fit certain parameters 
established in the project design (i.e., average IQ but 
"underachieving" in terms of expectations for average 
children entering first gradeV 

• Whether the groups of children (those tutored by trained 

volunteers, those tutored by untrained volunteers, and 

. ^ 

3/ ^ 

"* Not all children referred were tutored, however. As indicated above, one- 
third were put into the control group; others were not assigned tutors, Or 
their tutors never came. 
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control children) were comparable at the start of the 
project in learning characteristics measured by the 
IQ, achievement and visual-motor development tests 
used 

• Whether the trained and untrained groups of volun- 
teers were comparable enough in background charac- 
teristics (such as age , education, experience) , that 
the effects of Upswing training can be isolated with 
a reasonable degree of certaintyc 

Teacher characteristics are described because, although they probably cannot 

be controlled in a project of this nature , they undoubtedly enter into child 

progress or lack of progress. 

In addi:ion to the fundamental population profiles, the report describes 

teachers' and volunteers' attitudes t6ward the project in its early stages, based 

on their responses to "first impressions'* que'sfionnaires , 

DATA SOURCES 

As stated previously, a battery of tests was given, mostly during the 

fall school term, to all children identified for the project (including contxdl^ 

4/ 

group children.)— The tests used were the Slossen intelligence measure; the 
Metropolitan Primer; the Wide Range Achievement Test, Level I; and the Beery- 
Buktenica Developmental Test of Visual-Motor Integration . The children also 
were checked for normal eyesight and hearing. The same tests (appropriate 
levels) were given again at the end of the school year • The first results are 
reported here. The two sets of scores are compared in the final report. 



— Testing was supposed to be completed before tutoring began, so that the 
results could be used for screening the child candidates and would provide 
a "pre-tutoring" profile of the children who were involved. Problems with 
obtaining the tests, child absenteeism, and organization caused testing to 
be delayed and extended over several months in most cases. Tests were 
still being administered in January 1972. 
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Background information on volunteers and teachers was obtained 
through project registration forms provided to the uixiversity project officers. A 
parent registration form was used to get information on selected socioeconomic 
and attitudinal characteristics of the Upswing children, but the response from 
parents was very poor. (It appears that in St. Louis the parent registration form 
was never even distributed*) Short questionnaires (the "first impressions" 
forms) were sent to the city offices for distribution to volunteers, teachers, 
and parents about 2 months after tutoring began. The volunteer and teacher 
questionnaires were designed to draw out attitudes toward Upswing and toward ^ 
the preservice training and orientation given the volunteers. The parent ques- 
tionnaire sought information on the attitudes of both parents and children; 
however, again, very few parent forms were returned to ORI . The attitude 
questionnaires were developed by ORI, subject to review and modification by 
the USOE contract monitor, the National Center for Educational Statistics (NCES) , 
and the Office of Management and Budget (CMB) . 

DATA HANDLING 

Data handling has presented some problems this year. Under the 
project design, all data had to be collected and sent to ORI by the small and 
very busy project staffs in the cities. These people are not accustomed to 
survey work. ORI has had no real control over data-handling procedures 
because of the contractual arrangements of this project and because we had no 
people on-site to take care of the many details. 

The following is a brief review of procedures used by type of data. 
A description of problems encountered is presented for each case. 
Child Test Data 



W-»fl/ tests were administered and scored by Upswing staff in the cities 

and/or by graduate students hired for the purpose by the city directors. ORI 
^ provided each city office with a child record book in which both the pre- ar'^ 
post-tutoring test results were entered. The books were sent to ORI after the 
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first results were in, so that the scores could be put into our computer da^a 
files. The books were then returned to the cities for the final round of testing. 

Two major types of problems occurred— Incomplete data and delays. 
First, only the reading portion of the WPJ^.T was given in San Francisco. In 
addition, it appears there was some confusion in the scoring of the Metropolitan 
Primer in that city, so that the results cannot be used. The Beery Buktanica was 
not given in Denver because the project office wao unable to get copies of the 
test. These- difficulties are discussed In Section II. 

As mentioned previously, there were serious delays in the completion 
of the first round of testing m Denver and San Francisco; the child record books 
were not received from those citie^^ until March 1972. This appears to have 
been caused by difficulties in orgenization, scheduling in the schools, and 
child absenteeism. It is not known to what extent delays resulted from insuf- - 
ficient staff to do the scoring and recording for ORI . In addition, there were 
incomplete forms in the record books returned by Oxford and St.. Louis (because 
children were absent when various tests were given) . 

The delays in completing the "pre -tutoring^' tests havS had two reper- 
cussions. Most importantly, they obscure the effects of tutoring because there 
is no accurate indicator of the child's starting level. Second, testing delays 
have contributed to slowing the steps toward evaluation. The task of developing 
pre-tutoring learning profiles should have been completed earlier, for feedback 
to the cities on the nature of the children they were working with and to reduce 
the analysis and writing burden in the final months of the evaluation. 

ORI recognizes that special problems were encountered this year. It 
takes time to get any new project running smoothly, particularly one that in- 
volves so many different types of people and organizations. Upswing operates 
in the real world, not under laboratory conditions . The tests were not received 
from the publishers early enough in some cases. There were many activities 
other than testing going on in the project as well as in the elementary schools 
involved. The Denver director was not brought into tl^e project until after 
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school started, and the San Francisco school system was trouble<^ by conflict - 
over desegregation. In addition, of course; some delays are inevitable in 
glaring four different tests each to approximately 150 children dispersed over 
a school system {in 19 schools in Denver). It is necessary to obtain parents' 
permission first, and of course children may be absent. Nevertheless, it is 
believed th5" situation could be improved with careful planning and an earlier 
starting date in the 1972-73 school year. 
R egistration and First Impression s Forr:s 

It was planned that all Upswing forms would be issued under the name 
of rhe university in each city and would be distributed by the city project staffs. 
Follow-up also was to be conducted by the city staffs. The directors felt that 
communications from ORI and USO^ would likely threaten, confuse, or alienate 
the Upswing volunteers, teachers, and parents. It was felt that the data 
returns would be greater if the'farms were distributed and collected by a 
familiar organization. 

The citjes have not documented how, when, and to whom the forms 

were distributed, or how and when follow-up was conducted and who was con- 

i 

tacted. It appears that procedures were quite informal and that it may have 
been difficult to get people to return forms Registration data dribbled into 
ORI from October 197 1 to May 1972. First impressions questionnaires ca'no 
in from January through June 1972, ORI conducted its own follow-up on volun- 
teer and teacher nonrespondents to the latter instrument, since it appeared 
after close to 2 months (the fc^ms were sent to the cities the first week in 
January) that the returns would be so small the evaluation would be se lously 
impaired. The follow-up wa've went out with a letter and pre-addressed , post- 
age-paid return envelopes attached on March 13, ]972 , Finally, adequate 
returns were received. 

Postage-paid, pre-addressed envelopes should have been attached by 
ORI to all forms for return directly to the evaluation tean; . It is believed that 
some delays resulted from forms being held in the city offices until enough 
for a package accumulated and someone had time to mail the package It is 
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also strongly urged that, unless ORI could have a data -handling agent on-site 
in each city, someone directly responsible to the evaluation director (paid by 
ORI) it would be better to send out all forms from this office. A special effort 
could be made to guard against vhe feelings of threat, confusion, and hostility 
feared by the project directors. 

Two major problems can be related to overly loose questionnaire 
handling procedures: (a) incomplete d^ta, resulting in delays in the progress 
of the evaluation; and (b) difficulty in computing response rates. With much 
effort by all involved, over an extended period of time, good response was 
achieved on the volunteer and teacher registration and first impressions. None 
of the parent data can be used in the evaluation, however, because so few 
forms were received. 
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II. UPSWING'S CHILD POPULATION 
I 



PURPOSE AND CONTENT 

This section describes selected learning-related characteristics of 
the children in Project Upswing. The information presented has two major 
purposes here: 

• To establish whether the child -population in fact fit 
within the parameters stipulated in the project design 
(namely, whether the children were of average intelli- 
gence, but experiencing difficulty learning to read, 
while demonstrating no se jere perceptual Or cognitive 
pathology) 

• To establish whether the three groups of children in- 
volved (those tutored by trained volunteers, those 
tutored by untrained volunteers, and the control 
group children) were similar enough in initial charac- 
teristics for valid comparisons among the groups to 
be made . 
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T!ie "group learning profiles" have three elements: IQ, as an indicator 
of ability or potential to achievei.^; reading achievement level; and level of 
visual-motor integration, as an indicator of psychomotor development. Each 
child involved was measured on each of these elements, or characteristics, by 
means of a formal test. 

The data are used in the final evaluation of first-year project 

outcomes as baselines from which measures can be derived for two of the 

three dependent variables on which the evaluation rests — change in achievement 

2/ 

{with reading of primary interest) and change in psychomotor behavior 

The section also contains a review of background information about 
children in Denver who were assigned tutors. .These data were provided by 
parents who returned child registration forms. ORI planned to describe the 
children in the experimental groups in terms of background characteristics as 
well as learning characteristics. It also Vv^as planned to attempt to determine 
what relationships, if any, appeared to exipi; between change in achievement, 
etc. , and selected characteristics such as school experience prior to first 
grade, ability to establish relationships with other children, level of parents' 
education, and economic status of family. This kind of analysis cannot be 
attempted because so few parents returned forms. The Denver data were suf- 
ficient for presentation, although they -all not be used in the evaluation. 



ORI, as well as USOE and all city project directors, recognizes the limi- 
tations of the IQ test as a measure of ability, particularly for children this 
age identified by apparent learning difficulties. An IQ test was used as the 
best available method of ensuring that the Upswing children had "average 
ability," a constraint of the project design. As it turned out, children with 
tested IQs both above and below average were accepted Into the project; 
the test results generally were not used for screening, as described in this 
section under "Parameters of the Population.'* 

2/ 

No attempt was made to obtain an objective measure of change in children's 
self-esteem, the third dependent variable of the evaluation. The teacher 
and volunteer who worked with each child were asked to assess his change 
in self-esteem on the final questionnaire. These subjective judgments are 
described in Volume II. 



PARAMETERS OF THE POPULATION 

How the Children W e re Selected 

First grade teachers in the participating schools nominated children 
for Project Upswing based on their professional judgment after observation of 
their pupils during the opening weeks of school. In accordance with the pro- 
ject design, they were to choose children of average ability who were not 
achieving at the normal first grade levels, particularly in reading. Children 
with serious organic dysfunctions were not to be included among the candi- 
dates. A version of one of the Burks Behavior Rating Scales generally was 
used by the teachers as a screening aid; however, the scale was of limited 
utility since it focuses on "acting out" behcvior characteristic of children with 
neurological impairments . 

The city directors then selected children from among those nominated, 
according to the project needs. Their criteria included geographic distribution 
of cases, availability of tutors by area, socioeconomic background of child, 
whether a parent would give permission for the child to be in the project (in- 
cluding permission for testing, etc.) . After the children were selected for the 
project, pyschoeducational testing was performed. Hearing and vision tests 
also were administered; all Upswing children were to be within the range of 
normal functioning. 

Because of delays in testing, the Upswing test data were not used by 
the individual projects to screen children as was originally intended. Although 
the tests were supposed to serve as screening devices, they were used only 
to form the basis for the evaluation of project effectiveness. Screening on IQ 
was used in Oxford and, partially, in St. Louis. Beyond that, the tests were 
not used for scre^ening in any location. ORI understands that hearing and 
vision tests, for example, were still being given in January. Thus these tests 
were useless as far as the project is concerned, unless the volunteers were 
informed of any impairments detected. We do not know if this was done. Nor 
did we receive these test results; thus it is unknown how many, if any. Upswing 
children had serious impairments of this kind. 



2-3 



It is not clear to what extent the tests were intended to be used for 
diagnosis of learning difficulties. It appears that they were used this way 
only in Oxford, where the project director went over the results, giving diag- 
nostic help, with volunteer tutors who asked her to do so. ORI recognizes ttiat 
individual diagnosis is time-consuming and expensive. Hovvaver, the test 
results were available, and it is difficult to see how educational intervention 
can be effective without diagnosis somewhere along the way. Perhaps Up- 
swing's overall intent is modest— to use volunteers to work with undiagnosed, 
subjectively-screened children. If this is so, it should be clearly spelled out 
as such by the USOE . 

In some cases volunteers were able to analyze children's needs on 
their own; others received help from principals, teachers, or (in San Francisco) 
learning specialists affiliated with the project. It is interesting that the Up- 
swing test results were not made available to the teachers. ORI received many 
comments about "no feedback on tests'' during the interviews with teachers 
this spring. 

If testing is to be a part of Upswing's final implementation, the evalu- 
ation team would recommend that the directors work out 5rome more organized 
scheme of assisting volunteers with diagnosis, which would increase the bene- 
fits from the expensive process of testing. Otherwise it is best to continue 
not using the test data for diagnosis. This point should be cleared up before 
the second-year evaluation. 

Although the tests did not serve as screening devices, the results 
can be examined to assess the accuracy of the subjective screening procedures 
used. In addition, test scores on the Slossen and on the VMI will indicate 
probable cases of severe perceptual or cognitive pathology that are outside 
Upswing's scope. These cases will not be removed from the population but 
the impact of the project on them will be noted. 
Population Size \ 

Figure 2.1 shows a count, for the project as a whole, of the children 
in each of Upswing's three child groups (children with trained volunteers (T) , 
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FIGURE 2.1. NUMBER OF UPSWING CHILDREN WITH 
USABLE TEST DATA, BY STATUS GROUP 

(Total number of children = 473.) 
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children with untrained volunteers (U^ , and control— children with no volun- 
teer tutors (O) . A total of 47 3 children are represented in the figure. This num- 
ber is not the actual number of children who were involved in the project; rather it 
is the number on whom test data were received and who were still participating 
when the test data were coded. Twelve cases were not included in the 
count because of insufficient data. Other children who were tested trans- 
ferred out of the Upswing schools, were never assigned volunteers, or were 
excluded because their volunteers attrited and were not replaced. It was 
hoped that a total of closer to 600 cases would be available for analysis (about 
200 per group) , as called for in the project design. Unreported attrition (chil- 
dren and volunteers) and incomplete final test data are expected to reduce the 
number of cases even further. 

It can be seen in the figure that there are considerably fewer chil- 
dren in the group assigned to untrained volunteers. This probably occurred 
because slots for trained volunteers were filled first, so that training could 
begin, leaving fewer untrained volunteers to be assigned to children, and/or 
because more untrained volunteers attrited. (The latter reason is probably most 
important.) 

The reduced and uneven group sizes will pose some difficulties for 
the evaluation. For one thing, ORI will not be able to use Automatic Inter- 
action Detection (AID) to identify the conditions that have greatest impact on 
the dependent variables— change in achievement, self esteem, and psycho- 
motor behavior. 

Figure 2.2 gives the distribution by status group for each Upswing 
city. San Francisco has a much smaller population of children. The director's 
"Mid-Project Report Form'' indicates that they had difficulty getting referrals 
from teachers. They also ran into problems securing parental permission for 
children to be tested, because the schools did not have correct home addresses 
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CUT CUT C U.T CUT 

Denver , Oxford St. Louis San Francisco 

{Total = 124) ' (Total = 129) (Total = 125) (Total = 95) 



FIGURE 2.2. NUMBER OF CHILDREN WITH USABLE TEST 
DATA, BY STATUS GROUP AND CITY 
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and/or telephone numbers for many children. ~ The other cities have total 
populations of comparable size, Denver and Oxford have similar distributions 
over the three groups , with, like San Francisco, the fewest children in the U 
group (children with untrained volunteers) , The Oxford distribution of children 
by status group runs counter to this trend. ORI has no ready interpretation of 
this phenomenon. It is not related to greater attrition of college student volun 
teers because the percentages of studeM volunteers in Oxford's trained and 
untrained groups are about equal. 
The Children's Ages 

Figure 2,3 is a graph of the distribution of ages of Project Upswing 
children, by group. The age spread is considerable. The points are plotted 
at 3 -month intervals from age 6 years, 1 month, to age 7 years, 10 months," 
Each point represents all children with birthdates + 1,5 months of the plotted 
value . 

Figure 2,3 shows that the three groups of children are similar in age 
distribution, with the C and T groups particularly well matched. The lower 
percentage of U children who are about 6 years, 4 months old is not considerec 
significant. j 

The children's mean age (all groups combined) was 6 years, 8 months 
in November 1971, when Upswing tutoring began. Moreover, about one-fifth 
of the children were age 7 or older at that time, (The three-group average of 
children >7 is 22%, Vv^ith a range from 20% to 26%,) Thus it appears that the 
Upswing population may be older th^n the average population of fi.rst graders. 

The age distributions by city (Figure 2,4) show considerable variance 
Most importantly, the San Francisco and Oxford children tend to be younger 



"~ According to the director's report (p. 11), they received 166 referrals; 
, however they were unable to contact the parents of 5 7 of these children, 
and the parents of three children refused to permit them to participate 
in Upswing. Thus they began with a total of only 106 children, 44 fewer 
than called for in the project design. They have lost a good numoer of 
children represented in the figure through volunteer/child attrition. 
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than those in Denver and St. Louis. Fifty percent in San Francisco, and 46% 
in Oxford, were less than 67 years old when tutoring began, as opposed to 
about 30% younger than 6^ in the other two cities. 

The age data are important in the analysis of achievement test results 
(WHAT scoring allows for chronological age, Metropolitan scoring does not) 
and visual-motor integration test results. Age is considered in the presen- 
tation of test score distributions later in this section, 

DATA SOURCES 

Four tests were selected to operationally define the learning charac- 
teristics of the Upswing children; the Slossen IQ; the Wide Range Achievement 

Test (WRAT) Level I; the Metropolitan Achievement Series; and the Beery 

4/ 

Buktenica Developmental Test of Visual-Motor Integration (VMI)"-- 
The Slossen IQ Test 

The Slossen is an individual intelligence measure that yields a 
single, composite score more representative of verbal ability than performance. 
It is relatively quick and easy to administer and score— two reasons it was 
selected for use in Project Upswing. 

In addition, the Slossen claims a standard measurement error (SE) 
of only 4.3 IQ points, as opposed to a 10-point SE on the standard Wechsler 
Intelligence Scale for Children (WISC) .. This means that the Slossen is very 
accurate and reliable; a difference of seven or more IQ points would be sig- 
nificant in 90 out of 100 cases. 

It should be noted that Slossen scores cannot be equated with the 
scores yielded by more familiar IQ tests such as the WISC or California Test . 



~ A behavior rating scale also was used (in all cities except San Francisco) 
in the first step 01 child nomination by teachers. However, these data 
oannot be employed in the evaluation. The instrument, chosen before the 
project got under way at a meeting of the city project directors and USOE, 
was designed to detect neurological handicaps. No scoring and interpre- 
tation guide : s^available , apparently because the instrument obtained for 
Upswing use-^'was a preliminary. version that has subsequently been refined 
and standardized. Author-publisher permission to use the scale was not 
obtained. 
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of Mental Maturity (CTMM) . An IQ of only 75 points on the Slossen would 
be equivalent to an IQ of 85 on the WISC, while a Slossen score of 149 would 
be equivalent to a WISC score of 130. This difference is caused by the 
Slossen' s unusually large standard deviation— 24 . 7 , as opposed to the more 
common 15 or 16 points,— 
The WRAT 

Upswing administered the latest (1965) version of this standard, 
which has been in use since 1937 . There are two levels— one for children 
from 5 up to 12 years old and the other for children 12 years old through adults. 
Level I of. course was. used for Upswing. 

The complete battery covers all the basic school subject areas of 
reading, spelling (which subtest encompasses writing), and arithmetic. All 
three subtests, were given in every city except San Francisco, where only 
the reading portion was used. The tests measure proficiency in sensory-motor 
skills required in each sc^hool subject area. Reading proficiency, for example, 
is measured in terms of abhity to recognize and name letters and words. 

The WRAT scales correlate quite highly with intelligence in normal 
populations (in the* range of r = .70 - .80) . It is expected that this correlation 
will be considerably lower for the Upswing population. 

The accuracy of raw WRAT test scores (SE) is estimated at about 8% 
of the total variance of scores. In Upswing, this means that more than + 4 
points will be considered significant. 
The Metropolitan Achievement Test Saries 

This is a series of easy-to-administer, inexpensive, group achieve- 
rrent tests that can bi machine-scored. One major reason the series was 
included as part of the Upswing battery was to see how comparable its results 



ERIC 



— The Slossen's larger standard deviation was not taken into account when 
Upswing's criterion IQ range of 85-110 was established. The 85-110 
bounds approximate the average range on traditional measures (SD + 15) . 
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would be with the more expensive WRAT battery, since economics are always 

6 / 

a concern in educational projects, particularly those involving volunteers.— 

The Metropolitan Primer battery, designed for kindergarten and 
beginning first grade cnildren, was given as one of the initial Upswing tests. 
(The Primary Level I tests, designed to measure achievement from the middle 
of first grade through the middle of second grade was part cf the post-tutoring 
Upswing battery.) 

On close examination of the Metropolitan series ORI feels that several 
significant deficiencies exist. The most important weakness of the series 
appears to be the use of machine-score "answer sheets,, which require a high 
level of visual-motor integratior. for completion. The children must place 
pencil marks in highly specific locations on the answer sheet and avoid all 
stray marks. ORI considers this requirement unrealistic when testing any 
first grade population, let alone a populdtion selected on factors likely to be 
mediated by visual-motor difficulties, A second criticism is the poor quality 
of documentation presented by the authors. The methods of obtaining stan- 
dardization data appear suspect because of the small number in the "represen- 
*:ative" population and the fact that "representative" is nbt defined by the 
authors . 

The standard error has been computed in grade equivalents of -2 
(2 months) . Thus any differences exceeding 2 months will be considered 
significant. ^ 
The Developmental Test of Visual-Motor Integration 

This test, often referred to as the "VMI" or the "Beery-Buktenica /' 
is described in the scoring manual as "basically a tool for educational 



— Another reason for including the Metropolitan seems, pottritially , to be in 
conflict. It was felt that two sets of results would. provide a better basis 
for judgments about the children's initial achievement levels and any changes 
observed after the tutoring experience. 



2-13 



assessment," although it is widely employed as a clinical diagnostic device. 
It was designed primarily for use with preschool and primary age children. 

In briet, the test measures functional integration of perceptual and \ 
motor processes in terms of a child's ability to give a specific motor response! 
to printed symbols. The child is presented with a series of 24 geometric forms 
to be copied on paper- The forms are presented in order of increasing difficulty. 

The VMI was selected for use in Upswing because the collective 
experience of researchers indicates that learning difficulties are commonly 
associated with problems of visual-motor coordination, although these are 
often temporary problems caused by slow maturation or transient functional 
impairments that slowly resolve themselves. The test scores, which indicate 
a child's level of coordination in .chronological age equivalents, have a higher 
correlation with reading achievement in first grade than does verbal iQ. Thus, 
for the Upswing population, one would expect lower VMI scores than for the 
general population of children with a^^erage ability. In a normal population of 
children aged 2 to 15, the VMI correlates ,89 with chronological age. It is 
expected that the VMI age equivalents for Upswing children will have a 
lower correlation with actual age. 

Reliability and error meai^urements for the VMI are not included in 
the administration and scoring manual— a serious omission. ORI is obtaining 
a monograph that includes these measures, 

TCST ADMINISTRATION AND SCORING 

Children with Upswing volunteers, and the control children, were 
tested primarily between November and December ]971. Some testing, how- 
ever was carried on through January 1972. O.RI feels this long period of pre- 
"•esting will spuriously reduce t'..e magnitude of measured effects. Some 
children's scores no doubt reflect the "advantage" of later testing. As far 
as ORI knows, this effect is random over the three groups of children. 

Three of the four tests used in Project Upswing (the Slossen, WRAT, 
and VMI) are administered and scored on a one-to-one basis with the child. 
These tests were chosen because, when properly administered and scored, 
'they are far more sensitive than equivalent group tests. 
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The loose structure of the one-to-one situation, however, allows the 
tester to probe the child for responses. Probing requires considerable skill 
in order to avoid leading the child or discouraging him. The skilled tester can 
put the child at ease and excite his interest. In the same situation, a poorly 
trained or inexperienced tester can threaten a child, causing withdrawal and 
poor performance. This is particularly likely when the child is in some way 
offensive to the tester. The inexperienced tester is often unable to detect 
and control his own rejection of the child, but the child usuolly senses it 
immediately . Conversely, a poorly trained or inexperienced tester may prompt 
the child's responses or too readily interpret them as correct. 

Scoring individual tests also is m<^re subjective than scoring group 
tests. Very often, as in the VMI, responses can be infinitely varied but must 
be interpreted accurately as either acceptable or not acceptable on the basis 
of subtle, complex criteria. Scoring is noc always as clear cut as with the 
objective, machine-scored tests . It requires advanced training , sensitivity, 
and experience on the part of the tester before consistency and accuracy are 
possible. 

It is not possible for ORI to evaluate the ability of the many people 
who have served as Upswing testers. However, it is known people with 
varied amounts of training and experience served in this capacity in the 
four cities, and several cases of inadequate tester performance have been 
reported by project directors. An attempt has been made to correct the 
resulting inaccurate scores, but it may be that some of the reported scoies 
are inaccurate. The overall effect of using inexperienced or poorly trained 
testers is to reduce the overall accuracy of the present evaluation. 

SUMMARY OF TEST RESULTS 

On the whole, the children fall within the population constraints 
imposed by the project design. The test results for the three groups of chil- 
dren (controls, those with trained volunteers, and those with untrained volun- 
teers) are comparable for purposes of evaluation. The cities differ in some 
test outcomes. Highlights of the test results follow. 
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Intelligence— 

• More than 96% of Upswing children tested as 
having an IQ in the average range . The mean • 
score for the total population is 9 7.5. The Ox- 
ford children, as a group, had a lower mean IQ 
than tiie children in any other city, and those in 
Denver had a slightly higher mean score than the 
other children. 

Achievement 

• The age-adjusted WRAT shows that about 70% of 
the Upswing children were below average in 
reading achievement at the time they were tested. 
Almost half scored at or below the 20th percentile 
(below 80% of children their age) . The Metro- 
politan Primer scores were lower, on the whole, 
than the WRAT scores. Clearly, the Upswing 
population is an underachieving group of children. 

• Strong differences are evident when the WRAT 
results are compared with the Metropolitan results 
by city. The only constant is that Oxford children 
scored lowest on both tests. The two tests appear 
to be measuring on different criteria. 



— The project design specified children with average IQ. However, in all 
cities, some children who tested above or below average are involved « The 
city directors believe that the low-scoring children probably were handi- 
capped (in terms of performance) by cultural differences, including language. 
They also believe that above-average children who are experiencing diffi- 
culty in school fit within Upswing's scope. USOE and ORI agree with the 
directors on these points. Since IQ is not a dependent variable of the 
evaluation, this departure from the study design poses no problems. ORI 
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Visual-Motor Integration 

• Sixty-nine percent of the Upswing children tested 
as functionally immature. The mode VMI age equiv- 
alent was about 5| years. 

TEST RESULTS 

The data are presented in two ways, by status group and by city. 
"Status group" refers to the children's assignment to volunteers: control 
children with no volunteers (C) , children with untrained volunteers (U) , and 
children with trained volunteers (T) . Line graphs permit the test-score 
distributions to be compared readily. 

The following procedure was used to reduce the number of data points 
to meaningful categories. The range of raw scores on each test was divided 
/into 10 equal intervals for graphic display and cross tabulation. The center 
value for each interval was used as the plotting point. For example, if a set 
of scores ranged from 10 to 50, it would be divided into 10 four-point intervals 
then all cases in the interval of, say, 10-14 would be plotted as the score 
value of 12, while all in the interval 15-19 would be plotted as 17 , etc. In 
all cases, the intervals are small enough that the center value is within one 
standard error of all actual scores included in the interval. 

Where percentiles are presented, they are based on distributions of 
raw scores treated as described above. Because of the nonlinear relationship 
between raw scores and percentiles, the plots for percentiles are not equal 
interval . 

All points relevant to one city or status group have been connected 
by lines simply to indicate the rough shape of the distribution. It shoulc^ be 
noted that these lines do not represent a continuum of data points. 



will, however, attempt to determine whether IQ seems to be related to any . 
measured change in reading achievement, esteem, and psychomotor control. 
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Intelligence 

The Slossen results indicate that almost iOO% of the Upswing children 
were within the range of average intelligence (approximately 76. to 124 points on 
the Slossen) . In Figure 2 .5, only 5% or less of any of the three groups (C , U , 
and T children) scored outsfde the average range. The curves for the groups are 
comparable . 

Figure 2.6 points up variance between cities in intelligence score 

distribution. Oxford's children tend t:>ward the lov^er end of the average range, 

with scores in the interval from 72 tc 110. All three measures of central ten- 

dency are very close to 90 . The most noteworthy point about the Oxford results 

is that, contrary to expectations, relatively few of the children (less than 13%) 

8/ 

tested as having below-average IQ.— I'revious experience had shown that 
children from rural Lafayette County, Mississippi, tended to perform poorly on 
IQ tests. Thus, with the' Upswing IQ limits set at 85 and 110, the Oxford 
project director requested' and received authorization to include children who 

scored up to 10 points under the lower limit. However, since the Slossen has 

i 

a standard deviation of 24.5 points most of the Oxford children in fact tested 
as average without allowance for cultural bias. The test bore out the teachers 
belief that the children they referred were of average ability although achieving 
at a below-average level.' This speaks well for the Slossen as an instrument 
for use with so-called "culturally-deprived" or "disadvantaged" children. 
(The test has been used with disadvantaged children in Denver, but its 
appropriateness for that group has not been documented.) 

The San Francisco and Denver child IQ distributions approximate nor- 

1 

mal curves, with the San Francisco mean close to 100 and Denver's close to 
105. Both cities have very small percentages of below- and above-average 
scores, although Denver's percentage above average is greater than that of 
any other city. 

— - • ■ ~ ' " 

— Remember that Upswing's criterion IQ bounds were selected based on the 
traditional IQ measures that set average at 100 + 15. These limits are not 
appropriate for the Slcssen, whose average range is 100 + 24.5. 
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Ach i eveme nt 

Achievement level was measured both the WRAT and the Metro- ' 
politan Primer. WRAT results for the total population are presented in Figure 
2.7. The chart shows that the children were underachieving in terms of what 
the WRAT measures when they took the test: 72% of the children for whom data 
are available (N = 473) scored below the average range. A small percentage of 
children tested above average (6%), and about one-fifth (22%) tested as average 
achievers in reading. 

It should be noted that the WRAT scoring procedure includes an age 
adjustment. This makes the test both fairer to the children and a better evalu- 
ative and diagnostic measure. Since the percentiles are based on school 
achievement norms by age, a 6-year-oId is compared with a sample of other 
6-year-olds. That child would receive a higher percentile rank than a 7-year- 
old who made the same raw score. Thus the Vv/'RAT data perm.it a more refined 
conclusion: most of the Upswing children are underachieving for their ages. 
We know that those who tested average and above in reading achievement are 
not rSimply demonstrating an age advantage. 

It also should be noted that the children who tested as average and 
above still could be underachievers in the classroom for a variety of reasons. 
It will be remembered that the test was not used for screening. 

Comparability of the Children by Status Group. The WRAT results by 
status group of children are presented in a somewhat unorthodox way. For 
this analysis, effect of age on the children's scores was removed. This was 
done by assigning all Upswing children to the norm age range of 6 years, 0 
months to 6 years, 6 months, fof- the purpose of determining percentiles from 
raw scores. This range was suggested by the WRAT documentation. Based 
on the test's standardization samples, average reading achie'/omentln the 
second month of first grade (the closest point to the time of Upswing testing 
available in the WRAT documentation) equates with an age of 6 to 6^ years. 
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Achie vement 

Achievement level was measured by both the WRAT and the Metro- 
politan Priner. WRAT results for the total population are presented in Figure 
2.7. The chart shows that the children were underachieving in terms of what 
the WRAT measures when they took the test: 72% of the children for whom data 
are available (N = 473) scored below the average range, A small percentage of 
children tested above average (6%), and about one-fifth (22%) tested as average 
achievers in reading. 

It should be noted that the WRAT scoring procedure includes an age 
adjustment , This makes the test both fairer to the children and a better evalu- 
ative and diagnostic measure. Since the percentiles are baseu on school 
achievement norms by age, a 6-year-old is compared with a sample of other 
6-year-olds, That child would receive a higher percentile rank than a 7-year- 
old who made the same raw score. Thus the WRAT data permit a more refined 
conclusion: most of the Upswing children are underachieving for their ages. 
We know that those who tested average and above in reading achievement are 
not simply demonstrating an age advantage. 

It also should be noted that the children who tested as average and 
above still could be underachievers in the classroom for a variety of reasons. 
\t will be remembered that the test was not used for screening. 

Comparability of the Children by Status Group, The WRAT results by 
status group of children are presented in a somewhat unorthodox way. For 
this analysis, effect of age on the children's scores was removed. This was 
done by assigning all Upswing children to the norm age range of 6 years, 0 
months to 6 years, 6 months, for the purpose of determining percentiles from 
raw scores. This range was suggested by the WRAT documentation. Based 
on the test's standardization samples, average reading achievement in the 
second month of first grade (the closest point to the tirre of Upswing testing 
available in the WRAT documentation) equates with an age of 6 to 6^ years. 
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Now the Upswing children are being compared on the WRAT with average-age 
children rather than with children their own ages . 

ORI recognizes that this approach may be controversial, but it is 
believed to be valid and it offers advantages to the analysis of the relative 
merits of the WRAT and the Metropolitan Primer for Project Upswing use, as 
discussed subsequently. In any case , the comparability of the C, U, and T 
children in achievement can be examined adequately without consideration of 
age. Figure 2.3, under "Parameters of the Population" (page 2.3), shows that 
the three groups have quite similar age distributions. 

Figure 2.8 shov,/s WRAT reading scores distributed in a bimodal pattern 
that is similar for the three groups of Upsv,/ing children. The curves for the U 
and T groups are almost identical, while the curve for the control group is 
distinguished by a minor loading of children with scores at about the I9th 
percentile rank (i.e. , reading achievement equivalent to the kindergarten 6th- 
month level at 6 to 6^ years of age) . The C group's bimodal tendency is not as 
pronounced as that of the other groups . 

The bimodal pattern suggests that the Upswing selection process 
(primarily teacher judgment) has drawn two distinct subgroups of children with 
respect to factors measured by the WRAT . The bimodality also co\ild be 
attributable to personal interaction with Lester during WRAT administration and/ 
or to subjective scoring effects caused by spread in tester trainincj and 
experience. 

Figure 2.8 also points up the impact of age. Close to -50% of all three 
groups (singly and combined) fall in the average range or above, and the dominant 
mode achievement level for all is right at the lower boundary of the average range. 
Thus, when the Upswing children's ages are disregarded, the population as a 
whole moves up on the achievement scale . When the percentile ranks and 
grade equivalents are adjusted for age, as in Figure 2.7, we see that almost 
two-thirds, as opposed to about half in Figure 2.8, of the children tested 
below average. Since many of the children "stack up" reasonably well as first.. 
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graders, but not as older- than- average first graders, one wonders if teachers 
were considering chronological age or the appearance of physical or social 
maturity when they made roferrals. 

The Metropolitan Primer scoring does not consider age differences . 
The children are compared to a sample of . first graders whose age range, mean 
age, etc. , are unknown. There are two standardiza Lion samples, one tested 
at the end of kindergarten and the other in the fifth month of first grade. ORI 
based its interpretation of the Primer scores on the latter norms, after trying • 
both .1/ 

The initial expectation might seem to be that, since the Primer dis- 
regards age, the Upswing children should rank about as well on the Primer as 
on ti:>e WRAT without age adjustment. However, in Figure 2.9, about 15% to 
20% of all three groups fall in the average range or above. The. children defin- 
itely demonstrated lower-level achievement on the Primer. 

Table 2.1, a cross tabulation of WRAT and Primer raw scores, shows 
a fairly low correlation: .46 instead of the normally-expected .80 to .90. 
The correlation was computed on the basis of raw scores. 

In interpreting this outcome, one must consider that the Primer was 
standardized on a population teste i in the fifth month of first grade. Although 
testing extended into January of 1972, a3 noted in the beginning of this section, 



The San Francisco data were excluded from the analysis. It at first appeared 
that the Upswing children were not essentially different in reading achieve- 
ment from a random sample of tht. a veraae classroom . Since the finding was 
at odds with the WRAT results, ORI investigated* It appears that in San 
Francisco, the Primer was given on a one-to-one basis, which might par- 
tially account for the generally higher scores, since this is a group test 
intended to be taken without tester intervention. Mere importantly, an edit 
of the San Francisco data showed that many of the raw scores sent to ORI 
were outside of the range of permissibJe entries. It appears that a^mlx of 
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TABLE 2. 1 



GROSS TABULATION OF SCORES ON THE WRAT READING 
AND METROPOLITAN PRIMER TESTS 

(Numbers in cells represent numbers of children 
receiving both row and column score.) 



WRAT Reading 
Raw Score* 


Metropolitan Primer Raw Score* 


No Score 
Reported 


7 


12 


16 


21 


25 


3 0 


35 


39 


44 


34 


, 0 

i 


0 


0 


0 


0 


0 


0 


0 


1 1 


0. 


31 


1 


0 


0 


0 


2 


0 


1 


1 


0 


1 


27 


i 


0 


0 


1 


5 


7 


12 


8 


6 


1 


23 


3 


0 


0 


11 


12 


26 


19 


13 


\4 


0 


■ 20 


3 


0 


3 


8 


14 


19 


11 


6 


2 


0 


16 


2 


0 


1 


4 


17 


12 


3 


4 


0 


0 


13 


2 


0 


3 


9 


20 


5 


4 


1 


0 


1 


9 


10 


3 


6 


11 


12 


10 


1 


1 


0 


0 


5 


6 


2 


3 


5 


7 


3 


1 


0 


0 


0 


No score 


0 


0 


1 


1 


3 


2 


0 


0 


0 


0 


reported 























*The ranges of both WRAT and Primer scores were divided into 10 equal in- 
tervals. The scores posted are the rounded central values of the Intervals. 



Correlation: r = .46. 
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most of the children were tested in November and December. Those tested in 
November, at least, could reasonably be oxpected to have done less well 
than if they had been tested 2 months later. In addition, it will be remembered 
that in removing the age effect from WRAT scores, the children were assigned 
the age of the average child in the second month of first-grade. This would 
inflate the scores of Upswing children who were tested late. 

Thus part of the difference between the WRAT results in Figure 2,8 
and the Metropolitan Primer results in Figure 2,9 is probably a scoring artifact. 
Another condition, however, is believed to be more important— namely the for- 
mat of the Primer and its difficulty for the Upswing children. The Primer is 
machine-scored. Children are required to indicate their answer choices by 
filling in small spaces on an answer sheet. This is a difficult task for many 
first graders. Moreover, as will be seen in the analysis of the Beery-Buktenica 
test results (page 2.30, f f) , the larg3 majority of Upswing children manifest 
visual-motor integration problems . 

In contrast to the WRAT results, the Primer yielded, essentially, a 

10 

single mode at the 18th percentile for the status groups (Figure 2. 9).^'' All 
three WRAT distributions are bimodal (Figure 2.8) . Thus both tests indicate 

raw and standard scores may have been sent. It is not possible for ORI to 
sift these data to provide meaningful results. The Primary I test given to the 
San Francisco children at the end of the year as the Upswing post-tutoring 
test was not the correct form and cannot be compared with the Primer results. 
In addition, the post-testing was done on a group basis as opposed to the 
one-to-one basis for the Primer. For these reasons ORI cannot make any 
valid interpretations of the Metropolitan test data from San Francisco. 
Thus, San Francisco will no longer be considered in the Metropolitan por- 
tion of this evaluation. " 

— ^The slight peak in the C curve at the 42d percentile is not considered a 
significant deviation in view of the similar percentages of children who 
tested as average or above-average achievers in the three groups. It is 
interesting that the C group also showed a deviation on the WRAT. Its 
secondary peak, in that case also tended to raise the C's achievement 
level (very sli'jhtly) in comparison to the T and U groups, although in 
that case the secondary peak was at a much lower level. 
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that the C, U, and T children were comparable, — as well as that they were 
underachieving, in terms of what was measured. However, it appears that the 
two tests may measure different characteristics, at least in part. If so, then it 
also appears that the types of things measured by the Primer are more closely 
related to subjective criteria used m common by teachers to select the children 
for Upswing, while the WRAT is attuned to criteria not used in a common way 
by all teachers. In this connection, the Primer is highly curriculum-oriented. 
The test items are much like those found in traditional reading workbooks, 
probably because the test was designed to be group-administered and the items 
must be familiar enough in format that the child will not be confused. The WRAT, 
administered one-to-one, is less "classroomish" in content and requires social 
interaction with the tester. The point here is that teachers would be more likely 
to make homogeneous application of selection factors relevant to the straight- 
foPA^ard skills the Primer measures. 

Another possibility is that the more dynamic WRAT is a more sensitive 
instrument, beyond the sensitivity to age built into its scoring procedures. 
Since it is administered one-to-one , it probably recognizes a broader spectrum 
of achievement in children than would be detected by a static group measure. 
Further, as mentioned earlier, it may be that the WRAT bimodality is an effect 
of the range of skill of the testers, in test administration or scoring. 

Comparability of Children by City. When the WRAT and Primer results 
are analyzed by city, they reflect much the same differences as when analyzed , 
by status group of children. Again, the effect of age on the WRAT distribution 
has been removed, so that it can be compared directly with the Primer distri- 
bution. It has been established that this procedure inflates the children's 
WRAT achievement levels. Thus, here, only the comparability of the city 
populations, and their relative levels will be considered. 

__ ^ ^ 

— The control children do appear to have a slight lead over the other children 
on both tests. If there is a "genuine difference, it could have resulted from 
' children who were tested first being placed into the experimental groups so 
tutoring could get under way. If that were the case the control children, 
tested later, would appear to have a higher initial achievement level. 



2-29 



Figure 2.10 indicates that each location has a different child popu- 
lation with respect to what the WRAT measures. Oxford, San Francisco, and 
St. Louis all have bimodal distributions ^ but there the similarity ends. Oxford 
is almost a mirror reflection of St. Louis , with a high peak in the low range to 
reflect St. Louis's peak in the high range. San Francisco, on the other hand, 
displays a relatively even distribution of children across the WRAT range, 
with only minor peaks * Denver produced a curve quite unlike any of the others . 
It is a smooth curve, skewed to the right, peaking at the 25th percentile and 
rolling slowly off to around the 53d percentile 

It is clear from the WRAT scores that Oxford supplies the bulk of lowest 

scoring children to this project, while Denver, especially, and St. Louis 

12/ 

.provide the higher achiever s . — San Francisco provides children at all 
levels. This finding is reasonable because of the varied character of the cities. 
However, the Primer scores show a different picture. Figure 2.11 shows Oxford, 
St. Louis, and Denver as having virtually the same distributions. San Francisco 
Primer data are excluded from the analysis, as explained earlier. 

A number of possible explanations for the differences were discussed 
in the analysis of achievement by status group. These would hold for the 
analysis by city. Such tentative conclusions as can be drawn based solely on 
the "pre -tutoring" test data are presented at the end of the "Test Results." 
Visual-Motor Integration 

The following material pertains only to children in Oxford, St. Louis, 
and San Francisco. The VMI was not given in Denver. The numbers of the ■ 
Denver C, T, and U groups were removed from the totals before the percentage 
distributions of scores were calculated. 

The VMI results reinforce the similarity of the three groups of Upswing 

children. Figure 2.12 shows a single dominant mode performance level at an 
__ 

— Remember that Upswing high achievers can still be significantly below the 
national average; and that the achievement levels for the sizable group of 
Upswing children who are older than 5| are inflated in Figure 5.10. 
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at an age equivalent of 5 years, 5 months . — About 40% of all three groups 
tested at this level. About 23% of each group tested below that level and about 
30% of each tested at an age equivalent of 5 years or above. 

These results indicate that the children in general were functionally 
immature at the time of testing. About one-third in Figure 2.12 are below the 
5 year, 5 month level. Figure 2.13 shows the difference between VMI age 
equivalent and chronological age in years and months, for the total child pop- 
ulation for whom test data were received. (In this case, not only Denver is 
excluded, but the children in the other cities for whom no scores are available 
as well.) The comparison clearly establishes that 69% of the Upswing chil- 
dren (excluding the Denver population) had visual -motor integration significantly 
below normal for their ages at the time of testing. Thirteen percent tested 
significantly above the average expected performance level. There was no 
significant difference for about 18% of the children. It would appear that the 
reading difficulties of the children with below-average VMI scores would be 
attributable, at least in part, to psychomotor coordination problems. However, 
as discussed in the review of general findings (pages 2 -37, ff), the data indi- 
cate that there may be a low correlation between the WRAT and VMI scores. If 
that is the case, it could be an artifact of testing, or it could be the lesult of 
special characteristics of the Upswing child population. 

The data by city- (Figure 2.14) indicate that the children in all locations 
tended to perform below average on the VMI. There are differences among the 
cities, but these should be viewed in the perspective of the dominant trend. 

Oxford and St. Louis have child populations that are very similar in 
level of visual-motor integration. All three measures of central tendency, for 



The VMI documentation refers to the age equivalents as "chronological age 
equivalents (CAEs) However it is probably better to think of them in terms 
of performance age, similar to the mental age (MA) on the performance part 
of the Wise . 
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both cities, fall at about the age equivalent of 5 yedrs , 5 months. Ninety- 
nine percent of the Oxford children and 100% of the St. Louis children were 
at least 6 years old at the time of testing, and 69% of both populations were 
over 6^ (Figure 2.4). Thus it appears that visual-motor immaturity may have 
been factor in the learning difficulties they evidenced. 

In Figure 2.14, San Francisco displays a population slightly different 
from the others. The distribution is bimodal, with its dominant tendency like 
that of Oxford and St. Louis (children testing at a VMI age equivalent of about 
5 years, 5 months.) The secondary mode, however (representing 21% of the 
children) , occurs above the mean age of Upswing children (6 years, 8 months). 
Furthermore, the San Francisco children tend to be somewhat younger than the 
children from the other cities (although all were over 6 years old at the time of 
testing), with 49% older than 6j, as opposed to 69% in the other two cities 
from which VMI data were received. This would indicate tfiat a large portion 
of the referrals made by San Francisco teachers were not based on psychomotor 
immaturity. 

Discussion of General Test Findings 

The overall test analysis has had as its major purpose to present OKI's 
estimate of the degree to which Upswing approaches its stated population para- 
meters. In the course of the analysis we have also examined the strengths 
and weaknesses of the tests used. 

The three groups of Upswing children (C,U and T) are similar enough 
for comparative analysis on the characteristics tested. The test results 
indicate that, in general, the child population is reasonably well within the 
constraints of the project design. The Slossen results place nearly 100% of 
the children within the range of average IQ. The age-adjustc3d WRf.T reading 
scores show about 70% of the children underachieving for their ages, while 
the Metropolitan Primer scores indicate that about 70% were underachieving in 
relation to a random normal population of children tested in the fifth month 
of first grade. The two sets of achievement data are puzzling and conflicting 
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in a number of ways , but there seems to be little room for argument that the 
Upswing children, for the most part, demonstrated lower than normal achieve- 
ment in the test situation. As for the VMI measure, it found close to 70% of 
the children immature in the areas of psychomotor coordinalion that it covers. 
(Tnis was not a population, criterion , but it was an expected characteristic.) 
A significant percentage of ,childTeu,scored above average on the VMI, as on 
the WRAT and MetropoUtan Primer (approximately 30% of the children for whom 
data are available, in all cases)." 

It should be borne in mind that academic testing is not an exacting 
process. All too often, test scores are used to justify faulty conclusions; at 
best, they give the researcher a rough operational measure of the abstract. 

We have stated that^he WRAT and Metropolitan Primer measure com- 
ponents of achievement. It is also true that some components of achievement 
have not been (perhaps cannot oe) measured. It is, however, quite reasonable 
to assume that children who scor^e above average on the WRAT might truly 
be underachievers . The WRAT measures only a small s.^gnent of the multldl- 
mensiQnal construct known as achievement. The child who is unable to par- 
ticipate in class activities because of emotional immaturity may perform well 
on a test, while achieving very little in his teacher's eyes. The teacher's 
perception of ochievement is perhaps as valid a^ the test's, but neither pre- 
sents the total picture. This problem is of course compounded when a test 
that has no age norms is used, like the Metropolitan Primer. Such a test sug- 
gests that a 12-year-old first grader has no learning problem as long as his 
raw score is as high or higher than half the children used in standardizing 
the test. On the WRAT, this same child would stand out below the first per- 
centile as having a severe learning problem. 

It would seem reasonable to assume that the reading difficulties of 
Upswing children were commonly associated v/ith problems of psychamotoi 
immaturity. However, aberrations in the data' suggest that the correlation 
between the VMI and WRAT scores and the VMI and Primer scores may be low. 
Preliminary raw. scu: . "jrrelations between the WRAT and VMI, and Primer and 



\ 



VMI, were both very close to zero. Several intervening variables, not . 
operative in an average child populat^.on, couid have disrupted the normal 
relationship between visual-motor integi^ation and reading achievement. 
Such factors as language barriers and emotional problems come to mind from 
the interviews conducted with a sample of children in each city's project. 

The analysis of Upswing's first round' of testing suggests a need 
for documented, more consistent tester training in all cities. This is 
necessary so that all who administer tests have a known minimum level 
of qualification for their work. The data suggest that varying expertise 
may have distorted some of the results. 

ORI would also suggest at this time that a group achievement 
measure that offers age-adjusted percentile rankings to be sought for use 
in conjunction v/ith the WRAT or alone. It .should not be a machine-scored 
instrument. iN^ore consistent results probably would be obtained if the one- 
to-one and group tests used had comparable interpretation procedures. 

Elimination of the marking requirements for machine scoring would 
reduce the probability of erroneous test outcomes. An age-adiusted group 
test used as the sole achievemenL measure might satisfy Upswing's purposes. 
Certainly it would reduce the costs, and the problems of scheduling and tester 
training associated with one-to-one administration. 
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BACKGROUND INFORMATION ON DENVER CHILDREN 

Purpose . ' 

As stated i.n the introduction to this section, it was planned to describe 
the child population in terms of background characteristics as well as learning 
characteristics. The background data were to be provided by parents on the 
"Parent Registration Form." (See Appendix for copy of this form .) However , so 
few parents rn Oxford, St. Louis, and San Francisco returned registration forms 
that no background information about the children in those cities can be given. 
Only Denver children are described here. 

The data are presented for general information purposes only. The 
population described^ is not necessarily representative even of the total Denver 
child population, because of nonre^ponse (as discussed under "Parameters of 
the Population") . The data will not be used in the final evaluation of the im- 
pacts of Upswing iV its first year of operation. This section is included in the 
report at the request^of the U.S. Office of Education. 
D ata Source \ 

The data were collected via a parent 'registration form des igned by 
ORI foi* the projects in late August 1971 and mailed to them in Septe'-.oer 1971. 
In Denver, the forms were taken to the elementary schools involved in Upswing. 
The children (all except control group. children) were to deliver the forms to 
their parents and bring the completed forms back to school, where they would 
be picked up by Upswing staff for forwarding to ORI. 
Parameters of Populat io n Described 

With the method of distribution used, there are many opportunities 
for forms to be lost and no way of documenting who received a form. Further, 
the exact size of the population at the time the registration forms were dis- ' 
cributed is unknown, so ORI does not know even how many parents should 
hove received one. According to the Denver "Mid-Project Report Form" 
(conipleted in January 1972) , ]52 children were referred by teachers for par- 
ticipation in Upswing and none was screened out as a result of the testing 
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done for the project:; — Presuming that approximately 50 of these children 
were assigned to the control group, approximately 102 should have been regis- 
tered for the project. A memorandum from the project office shows that 1]0 
children were assigned tutors as of December 15, 1971. 

Under these circumstances , ORI must use what seems to be the most 
appropriate available indicator of the original size of the pe.rent population (in 
terms of number of children represented) to compute the response rate for the 
oarent registration form. Again, it is stressed that there is no record of who 
actually received a form. The number selected is 110, the number of children 

who were assigned volunteers as of December 15, 1971, according to the 

15/ 

Denver project office";: ORI has registration forms from the parents of 67 
children. Using 110 as the number of possible respondents, the response 
rate is 61%. The children described in the following pages are not necessarily 
representative of the total population of Upswing children in Denver. The back- 
ground characteristics of more than one-third of the population are unknown. 
Children's Family Background Characteristics 

Age , All of the Denver children for whom d:3ta are available were at 
least 6 years old when the 1971-72 school year uegan . Forty percent were from 
C years 0 months through 6 years, 5 months in age; 49% were from 6 years, 6 
months through 6 years, 11 months in age. Nine percent of the children reported 
on were 7 years old, with 8% of these under 7^ and 2% age 7| through 7 years, 
8 months . (Nonresponse to question— 1% .) 

Sex. Almost three-fourths of the 67 children whose parents registered 
them for Upswing were boys (72%, versus 28% girls). This is 44% of the prob- 
able total population of experimental group children (the 110 who were assigned 
volunteers cs of December 15, 1971). Since It is highly unlikely that the 



14/ 

The tests were not used for screening purposes. According to the Mid-Project 
Report all children referred for participation in Upswing by their ^eachers were 
being tutored (except those assigned to the control group) . 

— "^There is a slight discrepancy nere , in that 110 children were reported to be 
assigned to volunteers but 111 volunteers were reported to be "on the^job." 
This difference is considered unimportant. 
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parents of girls tend to be nonrespondents more than the parents of boys, it 
seems safe to assume that the majority of the Denver child population is male. 

Marital Status of Parents. It appears that the majority of Denver 
children for whom ORI has data are from two-parent homes . The answers choices 
for the marital status question were: single, married, separated, divorced, and 
widowed. Seventy percent of the responding parents checked "married." This 
implies that except for unusual circumstances, such as long-term illness of 
a parent, or father away on a military assignment, the parents were living to- 
gether. None of the responding parents said they were separated or widowed; 
3% said they were single, 25% said they were divorced, and 2% did not answer 
the question . 

The belief that most of these Denver children are from two-parent 
homes is supported by the responses to a question on number of adults living 
in the home,, This question apparently Vv'as confusing and the resport&es are 
not considered completely reliable. However, through analysis of individual 
questionnaires, ORI found that 45 children (67%) are from homes in which two 
adults are living (nine, or 13%, are from one-adult homes; three, or 5% are 
from homes witn more than one -adult; there was a nonresponse rate on this 
question of 15%, which includes responses that could not be interpreted) . 

Family Income , Figure 2.15 shows that the children tend to come 

from fn...ilies of modest means. Forty percent of the responding parents said 

they have family income of less than ^7,000 per year, while 55% have income 

of less than $10,0.00 per year and 80% have income of less than $13,000 per 

year. The national average income for a family of four was $12,414 in 
15/ 

1970.—* Thirty-six (54%) of the families represented by the parent 
registration data include three or more children, and 21 families, or 31%, 
include two children. The responses on number of adultb living in the home 
(item 12 on the form) were somewhat confused, but by reviewing each f orr , 



U.S. Department of Commerce, Bureau of the Census, Family Income 
Division (1971 survey data obtained by telephone) . 




FIGURE 2.15. FAMILY INCOME OF DENVER CHILDREN WHOSE 
PARENTS RETURNED REGISTRATION FORMS 

(Nonresponse to question: 10%.) 
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TABLE 2.2 



HIGHEST LEVEL OF EDUCATION OF DENVER PARENTS V^HO 
REGISTERED THEIR CHILDREN FOR UPSWING 



Highest L^vel of Education 


Mother 


Father 


8th grade or less 


3 


10 


I 


4% 


} 5% 


Attended high school 


20 


14 




3 0% 


21% 


High school graduate 


30 


27 




4 O /o 


4 U /b 


Attended college 


10 


7 




15%: 


11% 


College graduate 






(bachelor's degree) 


3 


2 




4% 


3% 


Some graduate school 


0 


3 




0% 


4% 


Advanced degree 


0 


1 




0% 


2% 


No response to question 


1 


3 




2% 


4% • 


Total 


67 


67 




,. 100% 


100% 
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ORI determined that 17 of the two-child farnilies also included at least two 
adults. This establishes that a inininnuin of 53 families (36 with three or more 
children, plus 17 with two children and at least two adults) have four or more 
members. That is, 79% of the children on whom ORI has data are from families 
of four or more. Thus it appears, from these data and the data on the family- 
income of Denver volunteers (Figure 3 . 6) , that the volunteers are considerably 
more affluent than the families of the children they tutor. 

Parents' E ■ucation. The Denver parents for whom ORI has data 
generally have had no formal education beyond high school. From Table 2,2, 
79% of the mothers and 76% fathers completed high school or less, with about 
one-third of both mothers and fathers below the high school graduate level • 
Fifteen percent of the mothers and 11% of the fathers attended college but did 
not graduate, while 4% and 3%, respectively, earned a bachelor's degree. No 
mothers have attended graduate school; 6% of the fathers have done some 
graduate work or earned an advanced degree , 

In comparison, 81% of the Denver volunteers have gone beyond high 
school. Table 3,7, on volunteers' highest level of education, shows that 
38% attended college (but did not graduate) , 22% have earned a bachelor's 
degree, ard 21% have done some graduate work or hold an advanced degree. 

Languages Spoken in Home, For 81% of the children who were 
registered for Upswing, English is the only language spoken at home. Nine- 
teen percent (13 children) come from bilingual homes. In most cases (9 of 
the 13) the language is Spanish, French, German, and Polish are each spoken 
• in one home. One parent did not specify the language . 
Children's School Experience Prior to Upswing 

Denver has both public school kindergarten and a Head Start operation 
(we are considering the latter as "nursery school," which was the response 
category on the parent registration form) . Thus it is not surprising that 95% 
of the children for whom ORI has data had some kind of school experience 
prior to first grade. Thirty percent attended both kindergorten and nursery 
school, while 65% attended kindergarten only and 1% (one child) attended 
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nursery school only. All of the children from bilingual homes (13, or 19% or 
the population) had kindergarten nursery school; or both, so they probably had 
some exposure to an English-language environment even if English were seldom 
or never used at home, (This of course could have been a confusing, frus- 
trating, or otherwise damaging experience for them as well as a helpful 
experience .) 

Children's Attitudinal Characteristics 

Attitude Toward School, The parents were asked about their children's 
attitudes toward school. ORI hoped to establish a baseline from which we 
could measure changes in attitude, if ary, over the school year* The data 
available indicate that the overwhelming majority of responding parents be- 
lieved thai their children had positive attitudes toward school at the start of 
the year. The responses were as follows: 

Num.ber and Percentage 
Child Attitude of Children • 

Enthusiastic or 55 
favorable 82% 

Indifferent 4 

6% 

Negative* 7 

10% 

No response to 1 
question 2% 

Total 67 

100% •• 

*The actudl response category was "slightly 
negative," A "completely negative" choice 
wa^^ included, but no-one answered in that 
way. 

R elationships With Other Children, Three questions were asked to get 
information about the child's sociP.l development: 

• Does he/she like tj participate in group activities 
at school? 
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• Does he/she get along well with other children in 

his/her age group? 
o Does he/she have regular playmates in the .neighbor- 
hood in his/her own age group? 
The overwhelming majority of parents indicated that their children had no 
difficulty in relating to other children. The responses to the first two ques- 
tions are shown in Table 2,3. The responses to the question about playmates 
in the home neighborhood were as follows: 

Does Child Have Number and Percent 
Regular Playmates? . of Children 



■ - No . . 6 

9% 

Only one 12 

18% 

Two 14 

21% 

Small group 27 

40% 

Many 7 

10% 

There are no other 1 
children in 2% 
neighborhood 

Total 67 

100% 

II is noted that the parents indicated that only 4% of the children did 
not get along well with other children, yet 9% were said to have no playmates 
in the home neighborhood. Since the answers included a no-playmates-avail- 
able option one would assume that is not th^^ problem. There could be several 
reasons for a child having no playmates even though they are available to 
him. In any case, both percentages (does not get along well and no play- 
mates) are so lew that the difference is felt to be unimportant. Another 
comment to be made about the playmates question is that it does not reveal how 
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many playmates were available to the child. Thus there is no way to interpret 
the distribution of children by number of regular playmates. The most impor- 
tant point to be made, however, is that most of the Denver children for whom 
ORI has data were able to maintain friendships with other children outside of 
school . 



TABLE 2 . 3 

INDICATIONS OF DENVER UPSWING CHILDREN'S 
SOCIAL RELATIONSHIPS 



Question 


Response 


Total 


Yes 


No 


Don't 
Know 


No 
Response 


Does child like to participate 


53 


5 




6 


3 


67 


in group activities? 


79% 


8% 




9% 


4% 


1C0% 


Does child get along well 


.64 


3 




0 


0 


57 


with other children?* 


9 6% 


4% 




0% 


0% 


100% 



*The actual response choices were: "Almost always" and "Usually" (inter- 
preted as "Yes"), "Not often" and "Hardly ever" (interpreted as "No"^, and 
"Don't know. " 
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III. PROFILE OF VOLUNTEERS 



PURPOSE 

This section describes the characteristics of Project Upswing's 
volunteer tutors. Trained and untrained volunteers are compared. Similarities 
and diffeiences between the individual city populations (trained and untrained 
combined) also are considered. 1/ 

The development oi the volunteer profile is one step in the evaluation 
of first-year project outcomes. It supports the evaluation in three major ways. 
First, of course, it indicates what kinds of people served as Upswing 
volunteer . Second, it shows how well the trained and untrained popula- 
tions were matched; the effects of training -ire of primary concern in the evalua- 
tion, und they can be isolated for analysis only the trained and untrained 
voluntoers are similar in other characteristics . Third, if differemces in 
project effectiveness (as measured by changes in the children's reading 
achievement, self image, and psychomotor behavior) are detected, differences in 
the cities* volunteer populations must be examined (among other variables)- It 

^ The data were not split on volunteer training status for the by-city presenta- 
tion. From the attrition data received up to now, and the nonresponse rates 
for the first impressions questionnaire, it is unlikely that ORT will be able to 
do a valid statistical analysis of the effects of training at the individual 
city level. 
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also was planned that the evaluation would seek to determine whether the 
selected background characteristics appeared to have any impact on volunteer 
effectiveness, (For example, did the children tutored by, say, college 
students, or by volunteers with previous related experience, make greater 
gains than other children.) However, attrition reduced the volunteer 
population to such a small total number that it could not be partitioned in 
that way and still provide meaningful data. 

The profile also serves as an indicator of the kinds of people who 
might reasonably be expectea to be drawn to a project like Upswing. The 
cities are diverse in nature and used various recruiting techniques; yet, as 
will be seen in the following data , their volunteers are similar in background 
characteristics. This suggests that certain types of people may be likely to 
serve as volunteers in education. 

DATA SOURCE 

All volunteers were asked to complete a university registration form 
designed by ORI. (A copy of the form is included in the appendix to this report.) 
Many did so during orientation or training meetings. The city project staffs 
conducted informal follow-up to obtain forms from nonrespondents among the 
original recruits and secured forms from those who joined the project later 
during the year. The volunteer profile is based on data from these forms. 

PARAMETERS OF THE POPULATION DESCRIBED 

According to the project design, each city v/as to have 50 trained 
and 50 uncrained volunteers, for a four-city total of 200 volunteers in each 
group. Beica se of the necessity to meet the quota for the trained group before 
training began, the cities filled those slots first. This procedure apparently 
reduced '^^^e suppLy of volunteers available for the untrained group, so that 
overall it had 39 fewer volunteers than the trained. 

All cities met the quoLa for trained volunteers, and Denver and St. 
Louis exceeded the quota, anticipating that there might be attrition and they 
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could not replace trained volunteers. Oxford was the only city to achieve its 
quota of untrained volunteers; that city exceeded the quota by two people. 
Denver and St. Louis came close, with, respectively, 48 and 46 untrained 
volunteers. San Francisco was able to recruit only 38 volunteers for the 
untrained group. Table 3.1 gives the number of trained and untrained 
volunteers in each city. 

The data presented here represent 100% of the 407 volunteers who 
originally registered for Upswing in the fall of 1971 according to the lists 
of volunteers provided by the city project offices. All but three of the "late 
recruits" also are included. (Three registration forms were received after the 
data Were tabulated in March 19 72 .) 2/ 



TABLE 3.1 

NUMB OF TRAINED AND UNTRAINED VOLUNTEERS WHO 
REGISTERED FOR UPSWING , BY CITY 



City 


Trained 


Untrained 


Denver 


68 


48 j 


Oxford 


50 


52 


St. Louis 


5 5 


46 


San Francisco 


50 


38 


Total 


223 


184 



The profile was not adjusted for volunteer attrition since its object is 
to show the characteristics of the original population. Characteristics of 
attritees are described in Voj.ame II, Section V. 
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SUMMARY OF VOLUNTEER CHARACTERISTICS 

• The majority of Upswing volunteers are married 
women homemakers (not employed full-time 
outside the home) . 

• They are fairly evenly distributed over the age 
range from 17 to 80, but there is a tendency 
toward the younger side (slightly under two- 
thirds are 40 or younger) . 

• The data indicate that the volunteers tend to 
have above-average income, 

• They are well educated. About two-thirds have 
bachelor's degrees, whil6 approximately 15% 
more have attended graduate school or hold 
advanced degrees. 

• About one-third had some formal raining in 
child development before volunteering for 
Project pswing, and about half had previous 
relevant experience as volunteer tutors/ 
teachei' aides, or teachers. 
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The trained and untrained populations are, on 
the, whole, quite similar in background charac- 
teristics, despite the fact that in three of the 
four cities they were allowed to choose train-" 
ing or no training ^ (The project design called 
for either random assignment or deliberate 
matching by the project directors.) 

The individual city populations also are, for 
the most part, similar. 

The most important differences, both between 
trained and untrained and between cities, are 
in age and, relat'^d to age, number of college 
students. There are more than twice as many 
people under 21 among the untrained volunteers. 
Almost all of these are attending college. 
Oxford has a much younger population of 
volunteers than the other cities, and 70% of 
the Oxford volunteers are students (compared 
with 28% students in San Francisco and Denver 
and 22% in St. Louis). St. Louis has a somewhat 
older population of volunteers than any of the 
other cities . 



VOLUNTEER CHARACTERISTICS 
Me 

Figure 3.1, based on the total population of Upswing volunteers (4 07 
in the four cities combined), shows two distinct age tendencies. First, the 
youngest volunteers ere concentrated in the untrained group: 31% of the un- 
trained volunteers are under 21, while about 14% of the trained are under 21. 

The second point is that except for the marked difference in the under- 
21 range, the two curves are almost identical. If the under-21 volunteers are 
removed from the sample and the percentages refigured based on the reduced 
totals, the curves for trained and untrained draw much closer together. In fact, 
the distributions for both groups become almost bimoda I , with a peak in the 
21-30 category a.nd a second, somewhat less pronounced peak in the 41-50 
category. Thus the two groups are remarkably we 11 matched on age , except 
for volunteers under 21. There is a tendency for the untrained population to 
be younger (because of its concentration of student volunteers) — 55% of the 
untrained are 30 years old or younger, versus 41% of thejuntrained (percentages 
based on the first three age categories combined). No one age category dominates 
either population in the sense that no category includes a majority of trained 
or untrained volunteers. Again, the mode age for untrained volunteers is 
"under 21 with secondary clusters in the 21-30 (24%) and 41-50 (17%) 
categories. The trained volunteers tend to cluster in two categories — 21-30 
(27%) and 41-50 (21%) . 

Table 3.2 shows that the very large difference in percentage of 
trained and untrained volunteers under 21 results primarily from an uneven 
distribution of Denver volunteers in that age group— four trained (8% of the 
Denver trained group) versus 21 untrained (44% of the Denver untrained group). 
Although Oxford has a very high percentage of volunteers under 21 (47% of its 
total volunteer population), they are about equally divided between the 
trained and untrained groups. 

Table 3.3, a cross tabulation of the data on student status and 
age, documents that almc t all of these youngest volunteers are students, as 
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TABLE 3 . 3 

AGES OF UPSWING STUDENT VOLUNTEERS, ALL CITIES 



Student Status 


■ 

<21 


21-25 


26-30 


31-40 


41-50 


51-60 


>60 


NR 


Total 


Student 


85 


39 


14 


8 


2 


1 


1 


0 


150 


Nonstudent 


1 


14 


27 


37 


57 


24 


13 


0 


173 


Nonrespondent 


2 


4 


6 


14 


19 


17 


21 


1 


84 


Total 


88 


57 


47 


59 


78 


42 


35 


1 


407 



3-9 

ERIC 



might be expected. From ^able 3.2, there are 88 trained and untrained volun- 
teers under 21. Table 3.3 shows that 85 of the volunteers who are under 21 
are students . 

There is variation in the age distribution of trained and untrained 
volunteers by city, as can be seen from examination of Figure 3.2, The most 
noteworthy difference is that Oxford has a much younger population of volun- 
teers than the oth^r cities. If we take 40 as a mid~point in the age ranges, 
92% of all Oxford volunteers fall below that point (and almost two-thirds are 
25 or younger) . The other cities are all much closer to an even split ever and 
under 40. San Francisco has 36% of its volunteers in the 21-30 range, while 
St« Louis has a slightly older population. 
Sex 

As shown in Table 3.4, the overwhelming majority (94%i of Upswing 
volunteers are female. Although the table does not include a breakdown by 
training status, the men are about equally divided- between the trained and 
untrained groups . 
Marital Sta tus 

The majority of both the trained and untrained volunteers are married. 
Figure 3.3 shows that married volunteers far outnumber the single volunteers 
in the trained group. The difference is small in the untrained group, another 
reflection of the concentration of students in that group. 

Figure 3.4 shows that the volunteer populations in the four cities vary 
in marital status, but married people predominate in all cities except Oxford. 
The high percentage of single volunteers in that city can again be related to 
its high percentage of student volunteers. 
Family Income 

Figure 3.5 is a cumulative diagram showing what percentages of the 
total trained and untrained populations are represented as family income in- 
creases through successive steps up the scale. Most importantly, the figure 
indicates that Upswing volunteers, both trained and untrained, probably tend 
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TABLE 3.4 

•SEX DISTRIBUTION OF UPSWING VOLUNTEERS, BY CITY 



Sex 


Denver 


Oxford 


St. Louis 


San Francisco 


Total 


Female 


111 


97 


96 


78 


382 




96% 


9 5% 


9 5% 


92% 


94% 


Male 


5 


5 


5 


10 


25 




4% 


5% 


5% 


8% 


6% 


Total 


1 1 6". 


102 


101 


88 


407 




100% 


100% 


100% 


100% 


100% 
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to have above-average income. A minimum of about 60% of the respondents in 

both groups have family income above the 1970 national average for a family 

3/ 

of four, $12,414 according to the Census Bureau's Family Income Division.— 
It also appears that the two groups are fairly well matched oh income. About 
10% of both groups have family income of $0-$4,999; slightly more than one- 
fourth of both have income of $9,999 or less (28% of the trained volunteers 
and 26% of the untrained); and about 40% of both have income of $12,999 or 
less* Eight percent fewer untrained volunteers have incomie between $12,999 
and $ 17,999, which causes the. two curve s to diverge . About the same per- 
centage has income from $ 17 , 999-$24 , 999 and above $24,999 . 

It should be noted a considerable percentage of volunteers did not 
answer the income question. Moreover, the nonresponse rates for the two 
groups differ: 8% of the trained volunteers did not answer the income question, 
while 18%. of the untrained did not answer. It is possible tiiat the data on non- 
respondents would alter the income distributions. 

Figure 3.6 permits examination of volunteer family income by city. 
Again, the rather high nonresponse requires caution in drawing conclusions 
from the data. 

The figuc'e^'^hows quite similar distributions of volunteers by family 
income in Oxford, St. Louis, and San Francisco. ' The most important differ- 
ence for these cities is in percentage of volunteers at the lowest level of ■ 
family income. The percentage of Oxford respondents at that level is almost 
three times as great as the percentage- of St. Louis respondents at that level, 
although in both cases the percentage are low (11% and 4% respectively) . San 
Francisco has a relatively high representation (20%"! at the $4 , 999 -or-below 
level, almost twice the percentage of Oxford volunteers in that income cate- 
gory. This reduces the overall level of San Francisco volunteer income as 
compared to the levels in the other cities. 

— U.S. Department of Commerce, Bureau of the Census, Family Income 
Division (1971 survey data obtained by telephone) . 
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The other important point to be made from Figure 3.6 is that the 
Denver respondents are more affluent than those from the other cities, partic- . 
ularly those from San Francisco. Seventy percent of the Denver respc-ndents 
reported income above $12,999 per year, while 61% in St. Louis, 57% in 
Oxford, and'-5Q% in San Francisco reported income above that level. (Again, 
the national average for a family oi four was $12,414 in 1970.) The difference 
is largely attributable to the lower percentage of Denver respondents with in- 
come below $5 , 000 and from $5 , 000 to $9 ,999 , and to the higher percentage 
with income of $25,000 er more. Regardless of these differences, it is clear 
that at least those who responded tend to have above^average income in all 
cities except San Francisco, and even there, one-fifth of those who answered 
the question said they have family income of $25,000 per year or more. 

Although it appears that there may be significant differences in volun- 
teer income among rhe four cities, the noniesponse rates make these differences 
at least questionable. One might expect volunteer income to be lowest in 
Oxford, because the income of the general population is lower there (as is the 
cost of living) . However, based on the available data, such does not seem to 
be the case. Again the question about colleqe student status arises, Oxford 
has a great many student volunteers (70%) who probably were reporting their 
parents' income as their own. 
Occupation 

The majority of Upswing volunteers are homemakers (not employed full- 
time outside the home) . The other important occupational category, as shown 
in Figure 3.7, is student. (The percentages in ih^, figure do not add to 100% 
because there is overlap among the categories. This is analyzed on pages 
3 .20 to 3.22 .) 

Figure 3.7 also indicates that the trained and untrained volunteers are 
reasonably comparable in terms of occupation, except in the student category 
and, to a lesser extent, in the homemaker category. The difference (28% 
versus 48%) in trained and untrained ^vho are students can be related to the 
disproportionate number of untrained volunteers under 21 in Denver (see 
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Table 3.2). As indicated in Table 3.3, almost all of these very young volun- 
teers are students. The higher percentage of students in the untrained group 
is reflected in a lower percentage of homemakers in that group compared with 
the trained, of whom a strong majority are homemakers. 

Table 3.5 shows that the cities are comparable in all occupational 
categories except, again, student and homemakcr. Looking at the cities with- 
out regard, for training status of volunteers, Oxford's heavy student population 
is evident. Correspondingly, Oxford tends to have fewer homemakers compared 
to the other cities, particularly Denver and St. Louis. The latter has the largest 
percentage of homemaker volunteers . 

Obviously, from Table 3 . 5 , some volunteers consider themselves in 

more than one occupational category. Some of the overlaps were identified 

4/ 

through cross tabulation.— For example people who checked that they 
are homemakers also checked at least -..^e other category: 

■ Homemaker (N = 237) 
Employed full-time: 1 
Employed part-time: 24 
Retired: 22 
Student: _22 
Total:' 69 
Of the 150 volunteers who indicated they are students, 66 put themselves in 
at least one other category as well: 

Students (N = 150) 
Employed full-time: ' 7 

Employed part-time: . 37 

Retired. 0 
Homemaker: 2_2 
Total: 66 

— If a volunteer checked more than two categories it could not be traced. 
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As shown above, there are no volunteers who are both retired and are students. 
There are, however, 22 retired people who also indicated they are homemakers 
and three who are employed pan -time. No retired volunteers said they are 
employed full-time. 

The 86 volunteers employed either full- or part-time are 21% of the 
total population. Table 3.6 shows that about half of these people (10% of the 
total population) are clerical employees. Another 20% (4% of the total) are in 

professional, technical, or managerial jobs. , ^^^7.^': 

Education 

The Upswing volunteers have had considerable education and the 
trained and untrained (all cities combined) are very similar in this character- 
istic (Figure 3.8) . The distribution is normal, with a substantial majority of 
both groups falling in the middle category — " Some College Through College 
Graduate." The distributions are similar for all cities (Table 3.7) . An average 
of 66% of the volunteers have had some college or have bachelor's degrees. 
On either end of the education spectrum, an average of 18% have a high school 
education or less and 15% have attended graduate school or hold advanced 
degrees. 

The volunteers who attended college were asked on the registration 
form to specify area of concentration. However, so few volunteers answered 
this question that the data are not useful. 

All volunteers were asked whether they had any previous formal 
training in child development before joining Project Upswing, and about one- 
third of the total population indicated they had. As can be seen in Figure 3.9, 
the trained and untrained are almost identical in this characteristic: 34% of 
•the trained and 35% of the untrained said they have had such training. Looking 
at the volunteers by city, as in Figure 3.10, the percentages are very similar. 
About a third of the population in all locations had background in child 
development before Upswing. 
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FIGURE 3.9. TRAINED AND UNTRAINED VOLUNTEERS' 
PREVIOUS FORMAL TRAINING IN CHILD 
DEVELOPMENT , ALL CITIES 

(Nonresponse rates: 12% trained, 10% untrained; total 11%.) 
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FIGURE 3.10. VOLUNTEERS WITH FORMAL TRAINING 
IN CHILD DEVELOPMENT, BY CITY 

(Nonresponse rates: Denver 12%, Oxford 15%, St. Louis 7%, 
San Francisco 10%; total 1]%.) 
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Related Piior Experience 

Over half of both the trained and untrained volunteers had prior 
experience as tutors, teachers, or teacher aides before joining Project Upswing. 
Figure 3.11 gives a breakdown by training status and specific type of experi- 
ence for the project as a whole. The figure points up a remarkable similarity, 
project-wide, between the tutoring/teaching background of the trained and 
untrained populations. The differences between the percentages of trained 
and untrained with teaching experience and with no experience is not impor- 
tant, considering the sizes of the populations and the nonresponse rates. 

Table 3.8 shows that the volunteers in the different cities also have 
comparable relevant experience. Oxford has the most volunteers with no pre- 
Upswing tutoring or teaching experience, but the difference is not great. JO-ne 
would expect more of a difference in view of the fact that there was no school 
volunteer program in Oxford before Project Upswing. Apparently about half of 
the Oxford volunteers gained experience elsewhere, St. Louis and, to a lesser 
extent, San Francisco have more people who have served previously as volun- 
teer tutors. Again, however, the difference is small and unlikely to have a 
bearing on the relative effectiveness of the volunteers there versus in Denver 
and Oxford . 
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IV. PROFILE OF TEACHERS 



PURPOSE 

The purpose of this section is to present background information 
about the teachers involved in Project Upswing, with emphasis on their edu- 
cation and experience. All information is presented for the overall teacher 
population as well as for individual city populations . 

DATA SOURCE 

A registration form developed by ORI was distributed to teachers 
during the teacher orientation sessions held in the cities in the early fall. 
For those teachers who did not attend the session or did not return the form, 
a persona^. ioUow-up was to be conducted by the individual project directors. 
A sample copy of the form is in the appendix to this report. AH teachers (130) 
v/ho volunteered to participate in Upswing are included in this profile. 

SUMMARY OF TEACHER CHARACTERISTICS 

# The Upswing teachers tend to be young. Thirty-eight 
percent are between 21 and 30 years old. The heaviest 
concentrations of young teachers are found in Oxford 
and St . Louis . 
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• Ninety-seven percent of all teachers are college 
graduates. Of these, 87% checked bachelor's degree 
as their highest degree earned, with only a small 
percentage holding any advanced degree . 

• Over half of the teachers had some training in edu- 
cation of children with learning problems prior to their 
participation in Upswing e Generally this training was 

the graduate level. 

• A large ma^rity of the teachers have three or more 
years of experience in the profession (regardless of 
grade level taught) , yet more than one-third are new 
(0-2 years) at teaching first grade. 

• Almost all Denver and San Francisco teachers, and 
about two-thirds of Oxford's, had wprked with aides 
or volunteers before Upswing. Only about a third 
of the teachers in St. Louis had any such assis- 
tance before their participation in Upswing. 

TEACHER CHARACTERISTICS 

Age 

The skewed curve in Figure 4.1 shows that the teachers involved in 
Project Upswing tend to be young. The modal age range for teachers in the 
four cities combined is 21-30. However, Figure 4.1 does show a second peak 
in the age range of 41-50. 

There are differences among the cities in age distribution of teachers 
(Table 4.1) . The modal age range in Denver is 41-50 and in all other cities 
it is 21-30. In San Francisco, however, the modal tendency is weak; the 
teachers there are quite evenly distributed over the range from 21-50. In 
Oxford, although the most common teacher age range is 21-25, there is also 
a large percentage in the 31-40 category. It can be said that all cities have 
rather high percentages of young teachers (30 years old or younger) . Oxford 
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'1 

45 




' 1 1 — ^1 1 1 

21-30 31 -40 41 - 50 51 -60 >60 

(61-65)* 

Age Range 

*Typical retirement age, 65, was 
chosen as the upper limit of the 
age range for this graph, 

FIGURE 4.1. AGE DISTRIBUTION OF TEACHERS, ALL CITIES 
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lABLE 4.1 



TEACHER AGE, BY CITY 



-Age Range 


Denver 


Oxford 


St. Louis 


San Francisco 


Total 


21-30 


17 


9 


11 


13 


50 




35% 


47% 


44% 


35% 


38% 


31-40 


7 


6 


3 


12 


28 




14% 


3 2% 


12% 


32% 


2 2% 


41-50 


21 


1 


4 


1 1 


37 




43% 


5% 


16% 


30% . 


28% 


51-60 


3 


2 


4 


1 


10 




6% 


11% 


]6% 


3% 


8% 


Over 60 


1 


1 


3 


0 


5 




2% 


5% 


12% 


0% 


4% 


Total 


49 


19 


25 


37 


130 


f 


100% 


100% 


100% 


100% 


100% 
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has a much younger teacher population than the other cities; Denver has the 

oldest teacher population. 

Education 

Figure 4.2 shows that 87% hold bachelor's degrees (their highest 
degree earned), while 10% have earned master's degrees and 1% have earned 
Ph.Ds. Only about 1% had less than a bachelor's degree. 

In all four cities (Table 4.2), the teachers are similar in level of 
education, although Oxford and St. Louis have considerably higher percentages 
of teachers with advanced degrees (M.A., M.S., or Ph.D.). Twenty-one per- 
cent of the Oxford teachers and 20% of those in St. Louis have earned advanced 
degrees, versus 8% in Denver and 5% in San Francisco. 

Figure 4.3 shows that 55% of all Upswing teachers have had some 
previous training in education of children with learning problems (71 teachers) . 
Denver and San Francisco teachers tend to have had more of this special training 
than the teachers in Oxford and St. Louis. The breakdown on level of training 
(Table 4.3) indicates that 77% of those with training had it at the graduate 
level. 

Teaching Experience 

Figure 4.4 shows, for the project as a whole, a fairly even distribu- 
tion of teaching experience over a range from 0^2 years in the profession to 
16 or more years. From the by-city breakdown, Table 4.4, Oxford (37%^ and 
St. Louis (40%) have more new teachers, by far, than the other two cities. The 
other differences among the cities are not believed to be important, although 
it is interesting that the St. Louis teachers tend to be novices or long-term 
veterans. 

Thirty-seven percent of all Upswing teachers (Figure 4.5) are new 
(i.e., 0-2 years* experience) to teaching first grade. Denver has more exper- 
ienced first-grade teachers than the other three cities, as indicated in Table 
4.5. On the whole, the Upswing teachers are less experienced at the first- 
grade level than their total years in the profession might lead one to expect. 
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Experience With an Aide or Volunteer 

Figure 4.6 clearly indicates that working with an aide or volunteer 
is not a new experience for the Upswing teachers —77% have had such assis- 
tance in the past. The by-city table , Table.4.6, however, shows significant 
differences among the cities. Close to 100% of the teachers in both Denver 
and San Francisco have worked with an aide or volunteer before. Teachers 
in Oxford and St. Louis have less experience. Sixty-three percent in Oxford 
said they have previously worked with an aide, and only 31% in St. Louis 
said they had any such experience before their participation in Upswing. 
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FIGURE 4.2. TEACHERS' HIGHEST LEVEL OF 
EDUCATION, ALL CITIES 
(Nonresponse to question: 
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TABLE 4.2 

TEACHERS' HIGHEST LEVEL OF EDUCATION, BY CITY 



Highest Degree 
Earned 


Denver 


Oxford 


St, Louis 


San Francisco 


Total 


B.A. , B,S. 


, 45-, 


■■- 14 


19 


35 


113 




: 927o" .- 


7 4% 


76% 


95% 


87% 


••M,A. , M.S. 


:> 4 


3 


5 


2 


14 




■' 8% " 


1 6% 


20% 


5% 


10% 


Other (Ph.D.) 


0 


1 


0 


0 


1 




0% 


5% 


0% 


0% 


1% 


None 


0 


0 


1 


■ 0 


1 




0% 


0% 


4% 


0% 


1% 


No response 


0 


1 


0 


0 


1 


, to question 


0% 


5% 


0% 


0% 


1% 


Total 


49 


•J? 


25 


37 


130 




10 0% 


100% ■ 


100% 


100% 


100% 
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TABLE 4.3 



LEVEL OF TEACHER TRAINING IN EDUCATION OF 
CHILDREN WITH LEARNING PROBLEMS 



Course Work in 
Education of Children 
With Learning Problems 


Denver 


Oxford 


St. Louis 


San Francisco 


Total 


Undergraduate 


6 


3 


4 


5 


]8 




12% 


16% 


16% 


13% 


]4% 


Graduate 


21 


3 


.6 




47 




43% ^ 


16% 


24% 


46% 


36% 


Other 


3 


1 


1 


1 


6 


e.g. , workshops 


6% 


5% 


■ 4% 


3% 


5% 


None 


19 


12 


14 


14 


59 




39% 


6 3% 


56% 


38% 


45% 


Total 


49 


19 


25 ■ 


37 


130 




100% 


100% 


100% 


100% 


100% 
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TABLE 4.4 

YEARS OF TEACHING EXPERIENCE, BY CITY 



Years of Experience 


Denver 


Oxford 


St . Louis 


San Francisco 


Total 


0-2 years 


2 


7 


10 


4 


2 3 




4% 


37% 


40% 


11% 


18% 


3-5 years 


17 


. 4 


3 


12 


36 




35% 


21% 


12% 


32% 


28% 


0-9 years 


8 


0 


1 


10 


19 




16% 


0% 


4% 


27% 


15% 


10-12 y >ars 


6 


4 


0 


2 


12 




1,3.% 


21% 


0% 


5% 


9% 


]3-15 years 


7 


0- 


6 


4 


17 




14% 


0% 


2 3% 


] 1% 


13% 


]6 years and above 


9 


3 


5 


5 


22 




]8% 


16% 


19% 


14% 


16% 


No response to - ' 


0 


1 


0 


0 


1 


question 


0% 


5% 


0% 


0% 


1% 


Total 


49 


19 


25 


37 


130 




100% 


100% 


100% 


100% 


100% 
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, TABLE 4.5 
YEARS OF TEACHING FIRST GRADE, BY CITY 



Years of Teaching 
First Grade 


Denver 


Oxford 


St . Louis ' 


San Francisco ■ 


Total 


Kj — 6^ ytiarb 




0 

cs 


1 n 
1 u 


1 Q 


4 0 




23% 


42% 


40% 


51% 


37% 


3-5 years 


12 


2 


3 


10 


27 




24% 


11% 


12% 


27% 


21% 


6-9 years 


14 


0 


2 


4 


20 




29% 


0% 


7% 


11% 


15% 


10-12 years 


• 5 


4 


1 


0 


10 




10% 


21% 


4% 


0% 


8% 


13 -15. years 


3 


1 


3 


3 


10 




6% 


5% 


12% 


8% 


8% 


16 years and above 


4 


3 


3 


1 


11 




8% 


]6% 


] 2% • 


3% 


8% 


No response to 


0 


1 


3 


0 


4 


question 


0% 


5% 


12% 


0% 


3% 


Total 


49 


19 


25 


37 


130 




]00% 


100% 


100% 


100% 


100% 
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or Volunteer Before 
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Did Not Work With 
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Before Upswing 



FIGURE 4.6. TEACHERS' EXPERIENCE WITH AN 
AIDE OR VOLUNTEER, ALL CITIES 
(Nonresponse to question: 1%.) 
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TABLE 4.6 



TEACHER EXPERIENCE WITH AN AIDE OR VOLUNTEER, BY CITY 



Response 


Denver 


Oxford 


St . Louis 


San Francisco 


Total 


Yes 


46 


12 


8 


35 


101 




■ 94% 


63% 


31% 


95% 


77% 


No 


2 


7 


17 


2 


28 




4% 


37% 


68% 


5% 


22% 


No response 


1 


0 


0 


0 


1 


to question 


2% 


0% 


0% 


0% 


1% 


Total 


49 


19 


25 


37 


130 




100% 


100% 


100% 


100% 


100% 
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V. FIRST IMPRESSIONS OF PROJECT UPSVnTING 



PURPOSE 

This section presents the initial opinions about Project Upswing 
expressed by the volunteer tutors, teachers, and parents involved. The 
volunteer impressions are analyzed for the project as a whole by training 
status of volunteers, as well as by city. Teacher impressions also are 
analyzed for the v/hole project and by city. Selected volunteer and teacher 
impressions are then compared. Only the Denver parents* first impressions 
are presented, because of insufficient response from the other cities. 

This section is included in the final report on Upswing's first 
year to document how the project was perceived in the early stages of 
tutoring. Elements of these attitude data also were explored for impact 
on change in children's achievement, as described in Volume II, Section 
II. ■ ■ 

DATA SOURCE 

The data presented in this section were taken from three "First 
Impressions Questionnaires," one for each of the above categories of 
participants, developed by the OKI study team with review and consultation 
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by the U.S. Office of Education. (Copies of the questionnaires appear 
in the appendix to this report.) Sets of each form were mailed by ORI to 
the city project offices on January 3, 1972 for distribution to the schools 
where Upswing tutors were working. The teachers and volunteers were to 
pick up their forms at the schools. The children were to take the forms 
home to their parents. Completed forms were returned to the schools, 
where they wera collected by project staff for mailing back to ORI. 
Follow-up questionnaires were sent to the nonresponding teachers (at their 
respective schools) by ORI on March 13, 1972 , with postage-paid, pre- 
addressed envelopes attached for direct return of completed forms to ORI. 
Follow-up questionnaires were sent by ORI to nonresponding volunteers 
at their home addresses, as shown on their registration forms, on March 
30, 1972. V 

ORI cannot document the number of questionnaires actually dis- 
tributed to each response groups in the initial wave, as this task was 
carried out by the project offices in the cities. Response rates for vol- 
unteers and teachers were computed based on the number of each group 
known to have received a questionnaire (that is, the number who returned 
a questionnaire after the initial distribution, plus the number who were 
sent a follow-up form by ORIy provided that the follow-up letter was not 
returned marked "addressee unknown") . 



The ORI follow-up was not originally planned. The city project staffs 
were to attempt to get nonresponding teachers and volunteers to com- 
plete questionnaires. Their efforts were delayed by semester breaks 
at the universities where the project offices are located. When it 
became evident that the response rates were not going to reach accept- 
able limits, ORI conducted a second follow-up by mail, in March y 
which yielded adequate data from teachers and volunteers. (ORI was 
requested not to follow up on parent nonresponse because the directors 
feared the parents would be intimidated.) 
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VOLUNTEERS' FIRST IMPRESSIONS OF PROJECT UPSWING 

Parameters of the Population 

The data presented here are based on the responses of the 261 
volunteers who returned first impressions questionnaires by the cutoff 
date of May 1 , 1972. This number is 77% of those known to have received 
the form (341 people.)-?/ The response rates by city (based on the number 
of known recipients in each city) are as follows: Denver, 69%; Oxford, 
80%; St. Louis, 91%; San Francisco 74%. 'The rate of return from St. Louis 
was significantly higher than from the other cities. It is possible that 
this higher rate accounts for variation of response between the St. Louis 
and other locations. At least, it is impossible to judge how the respondents 
from other cities would have replied had they returned their questionnaires. 

The above response rates (total and by city) are "worst-case" 
rates. Some volunteers who did not return questionnaires may have failed 
to do so because they attrited so early that they could not give valid first 
impressions. This is not only possible, but likely. ORI has found that 
the city project staffs did not necessarily know about attritees (the St. 
Louis staff was an exception here) . Some volunteers who registered never 
showed up at the schools, and others came only a few times. From ORI's 
field visits it appears that volunteers often did not inform Upswing of their 
decision to leave the project. Since the attrition data were incomplete, 
such people were sent follow-up questionnaires. They cannot fairly be 
counted as nonrespondehts; rather, they should be removed from the first 
impressions population. ORI does not know how many such cases. 

It will be remembered from Section III that 407 volunteers registered for 
Upswing. A total of 341 of these people are known to have received the 
first impressions questionnaire . The difference between these two 
numbers — 66 volunteers — gives an indication of the amount of volunteer 
attrition from the l?eginning of the project to May 1 , 1972 . It probably 
is not a highly accurate indication, however, since we know that some 
volunteers who returned forms, as well as some who did not, had attrited. 
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if any, there are, and will not know until complete attrition data are received 
froni the projects. In any case, the first impression response rates are not 
inflated. 

V olunteer Initial Opinion 

The responding volunteers' first impressions of the project were, on the 
whole, quite favorable. The majority indicated that: 

• They believed the experience would benefit most 
of the children involved. 

• They believed that the training or orientation they 
received was at least adequate. 

• They anticipated that the tutoring methods and 
materials they were using would prove to be 
effective . 

• They indicated that they had little difficulty in 
establishing good relationships with both chil- 
dren and teachers . 

• They indicated that they were satisfied with the 
amount of guidance being given by teachers. 

• They found the task of preparing for tutoring use- 
ful and interesting. 

• Experience bore out their expectations about . how 
challenging tutoring would prove to be. 

• They felt satisfied with their role as Upswing 
volunteers . 

The trained and untrained respondents expressed very similar opinions 
about all topics covered by the questionnaire except the preparation for tutoring 
given by Upswing (training and orientation) , and the adequacy of the guidance 
they were receiving from teachers. The untrained tended to be less satisfied 
with these aspects of their experience as volunteers. Nevertheless, 59% of the 
untrained found their preparation adequate or excellent, 51% found that they had 
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sufficient or more than enough training to use the methods and materials of 
tutoring , and 59% were satisfied with the amount of guidance being given to 
them by teachers. 

When the data are analyzed by city, there are some apparent differences 
in degree of satisfaction in certain areas. For example, the Oxford respondents, 
compared to those from the other cities, showed more positive feelings about the 
value of the project to the children, rated their training or orientation more highly, 
appeared to have more faith in their approaches to tutoring, and appeared to have 
a higher level of general role satisfaction. On the other hand, they also seem 
to have preferred more teacher guidance, or to have been receiving less than the 
respondents in the other cities, Denver vies with Oxford in positive predictions 
of effects on the children. The Denver and St. Louis respondents tend to have 
found it easier to establish good relationships with their pupils. 

The foregoing might seem to suggest that the Oxford project is strongest 
in terms of volunteer satisfaction. It is stressed, however, that the responses 
to all questions were on the positive side in all locations. No judgment on the 
relative effectiveness, or even on the relative degree of volunteer satisfaction, 
of the individual city projects should be made at this time. 



Volunteer Opinions About Project Upswing's Potential Effects on Children 

The volunteers demonstrated strong positive feelings about the project's 
overall worth on the first .impressions questionnaire. Seventy-three percent of 
all respondents said they believed Upswing would benefit most of the children 
involved, while only one respondent (less than 1%) believed it would benefit 
none of the children. 

The. trained and untrained respondents expressed very similar views 
(Figure 5.1). There is also little difference of opinion between cities, although 
the Oxford volunteers seem to have had a slightly more positive attitude about 
the project's potential benefits (Figure 5*2) . The most important point to be 
made about these data is that a substantial majority (67% or more) in all locations 
said they felt the project would benefit most children. 

The volunteers were also asked for an assessment of the probable 
effects of the Upswing experience on the specific children they tutor. As might 
be expected, their responses to this question tend to be more to the center than 
their responses to the question about project impact in general. Thirty-six 
percent of all respondents anticipated major improvement in the progress of their 
pupils, a sizable group; but the majority (59%) predicted limited improvement. 
Four percent felt that the experience would have no effect on their pupils' pro- 
gress . (There was a fourth answer option — "Project Upswing probably will in- 
terfere with the progress normally made by my pupil." However, none of the 
respondents chose this answer.) 

The trained and untrained groups were very similar in their expecta- 
tions about specific child progress, as shown in Figure 5.3. Comparing the 
volunteers by city, however, there are differences. In Figure 5.4, Denver 
and Oxford respondents are well-matched, and have significantly higher expec- 
tations than the equally well-matched St. Louis and San Francisco respondents. 
It should be kept in mind that interpretations of the terms "limited" and "major" 
of course vary with the individual. What would be viewed as limited improve- 
ment by one might be viewed as major improvement by another. -Nevertheless, 
such differences would be expected to affect the responses in all cities equally. 



5-6 

ERIC 



,00 -J- 

80 

70 
60 



o 
o 

in 

c 
o 

GL 

I 40 



30 



20 



10 



71% 





Beneficial to Most 
Children 



My first impression is that Project Upswing 
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a. Be beneficial to most of the 

children participating □ 

b. Be beneficial to some of the 

children participating □ 

c. Not be beneficial to any of the 
children participating □ 
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Beneficial to Some 
Children 



FIGURE 5.1. TRAINED AND UNTRAINED VOLUNTEERS' OPINIONS 
ABOUT UPSWING'S POTENTIAL TO HELP CHILDREN, ALL CITIES" 

] (One untrained (1%) felt the project would benefit no 

/ children, Nonresponse to question: 1% trained.) 
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Thus the attempt here is not to quantify improvement expected by :he volunteers, 
but rather to detect the general quality (positive or negative) of opinions . 

Volunteer Comments About Project* s Potential Effects on Children 

"It is my feeling that children who get extra help and atten- 
tion benefit . " 

"It is my hope that Project Upswing will prove itself to 
teachers, principals, parents, etc., so that volunteers 
can play a role in the education of children." 

"Since I am in untrained- 'group , I don't feel the progress 
due to my help will be anything exceptional. " 

"Improvements in stimulating the child's interest in school 
have been a possible result of Upswing ." 

"It would seem to me to be hard to measure whether it's . 
the volunteer, the teacher, or simply maturation which 
makes the difference." 

"I believe that the one-to-one relationship is very beneficial — 
possibly more in attitude toward self and learning than in 
actual learning gain." 

"I can't help but. .feel that these children will suffer because 
of the time lost in classroom teaching while they are with 
us." 

"Because the tutors are basically. untrained, I can't see any 
giant steps forward being made." 

"Any personal contact with a qualified adult volunteer can 
only be a 'plus factor.'" 

"Ideally, education is individualized instruction, and that's 
what Upswing is all about." 



ERIC 



5-11 



Volunteer Opinions About Training or Orientation 

Approximately 50% of both the trained and the untrained volunteers who 
returned first impressions questionnaires indicated they felt the preparation for 
tutoring (training or, for the untrained, orientation) given to them was "adequate'^ 
(Figure 5.5) . However, more than twice as great a percentage of trained volun- 
teers felt that their preparation was "excellent." This suggests a tendency for 
the trained respondents to have a somewhat higher opinion of the preparation 
given to them, a tendency that is supported by the percentages of trained and 
untrained who felt their preparation was inadequate (15% of the trained checked 
"inadequate/' versus 26% of the untrained). - Moreover, "adequate" is a catchall 
term that probably represents a broad range of feelings from mostly positive to 
mostly negative . "Excellent" and "inadequate" are more decisive term.s 
that are indicative of a strong opinion. This premise was substantiated by an 
analysis of spontaneous comments that qualified many of the "adequate" 
responses . 

The differential rates of nonresponse to the question also are note- 
worthy. FourteL^n percent of the untrained did not answer the question, whereas 
only 1% of the trained did not answer. The most likely interpretations of the 
high nonresponse for untrained volunteers are: (a) a sizable group of them felt 
the question was inapplicable, or (b) a sizable group did not attend the orien- 
tation meeting for untrained volunteers. 

There is also variation in the volunteers' attitudes toward training/ 
orientation in the different cities. Table 5.1 shows that the Oxford respondents 
clearly tend to value the training/orientation more highly than the respondents 
in any other city. The St. Louis respondents have the most negative opinion of 
the training/orientation. Although 52% thought their preparation was adequate, 
more than twice as great a percentage felt it was inadequate as felt it was * 
excellent. In all other cities the "excellent" responses outweigh the "inade- 
quates" (and by a very large margin in Oxford, as noted above) . The rates of 
nonresponse to the question are comparable for all cities. 
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A similar but more specific question was asked as a check on the 
volunteers' general feelings about training and orientation. Again, a difference 
between the opinions of trained and untrained respondents is evident (Figure 5.6) . 
About 60% of the trained said they had more than enough or adequate trai'^ing 
to use the methods and materials of tutoring, whereas about half of the untrained 
answered the same way. The percentages of trained and untrained respondents 
who said they had more than enough preparation are both very small, although 
the percentage of trained who answered in this way is more than twice as great 
(5% versus 2% of ine untrained) . The tendency for untrained to feel less well 
prepared is increased by the 45% of untrained volunteers who answered that 
they needed more training, versus 34% of the trained. 

In Table 5.2., we see again that the Oxford respondents tend to show 
greater satisfaction with their preparation for tutoring. Thus, based on the two 
sets of responses (Tables 5.1 and 5.2) , it might be that training and orientation 
were more effective in Oxford than in the other^cities . Other factors, however, 
may be iavolved. It is known that there has been much more interaction be- 
tween the Upswing director, staff, and the volunteers in Oxford than in the 
other cities. Fast, personal problem-solving may have entered into the Oxford 
volunteers* opinions about their training and orientation. This will be explored 
more thoroughly in Volume II of the report (Section II) . 

Table 5.2 shows that the respondents from the other three cities ex- 
pressed comparable opinions about their preparation to use the methods and 
materials of tutoring. In all three cases there is a fairly even division between 
the percentage who felt adequately jprepared a. u the percentage who felt they 
needed more training, although the "adequate" category is larger due to its 
broad interpretation by respondents. There is some difference between 
the distribution of St. Louis responses in Tables 5.1 and 5.2. The first table 
indicates that the St. Louis respondents may have tended to be less satisfied 
with their preparation for tutoring than the respondents in all other cities. How- 
ever, there is no indication in Table 5.2 that they are any less satisfied with 
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their preparation for using tutoring materials and techniques than the Denver or 
San Francisco respondents , 

Volunteer Comments About Training or Orientation 

"I was not trained at all. I feel I definitely need training 
and suggestions to do a better job." 

"Too general. " 

"Training program perhaps too concentrated." 

"Excellent in giving general approach and philosophy and 
some sp^■cific suggestions." 

."I think there should be more demonstration and more par- 
ticipation by the volunteers and less highly concentrated 
lecturing . " 

"The training was too lengthy and too complicated." 

"I felt much more able and capable to do the tutoring after 
having training*" 

"I felt we should have had more training in just communi- 
cating with the child and getting him interested." 

"If I had not taught before or taught my own children, I'm 
not sure it [training] would have been [adequate]," 

"No general training program-can really prepare the volun- 
teer for the very specific unique problems of each child," 

"It is giving me a feeling of assurance that I would 
otherwise have lacked." 

"Outstanding orientation." 

"At first I thought training was inadqqu^te, but now I 
,,,, realize it gave me a good background arid resources 

with which to work and pursue more knowledge." 

"I benefited from being in the trained group as I had never 
tutored before . " 

"I am in the untrained group and I certainly feel the lack 
of training. The orientation sessions were excellent." 

"Training given was very good; but I often feel inadequate 
when I think that someone with much more training and 
experience could put those 2 short hours a week to much 
better use for the child than me. " 



ERIC 



5-18 

•* 



Volunteer Opinions About Probable Effectiveness of Tutoring Methods and 
Materials 

' From the data presented in Figure 5.7, there is no difference in the 
trained and untrained respondents' first impressions about the probable effec- 
tiveness of the methods and materials they use in tutoring. The vast majority 
of both groups felt their methods and materials would prove effective. 

The first questionnaire did not ask what actually was being used and 
to what extent; that information was requested for the entire tutoring period in 
the final questionnaire. Therefore the trained volunteers' responses, summarized 
in Figure 5.7, should not be taken as an endorsement of DISTAR and/or Peabody— 
the reading instruction packages provided for the trained group by Upswing. ORI 
found during the recent interviews with a sample of the volunteers that many of 
the trained may have made little use of DISTAR or Peabody, 

Table 5.3 shows that a strong majority (94%) of respondents in all 
cities thought the tutoring materials and methods they were using would be , 
effective. However, the Oxford people again register more positive opinions 
than the" respondents in the other cities. The Denver, St. Louis, and San Fran- 
cisco people expressed ^comparable views. 

> 

Volunteer Comments About Probable Effectiveness 
of Tutoring Methods and Materials 

''The more I go into the field, the more I realize my lack of 
specific skills and knowledge." 

"I would like to know the relationship of the methods to one 
another to achieve the final goal." 

"I find myself groping to locate specific problems and so- 
lutions more than seems desirable." 

"I feel that there is more need to know how to use the 
materials provided." 
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Volunteer-Pupil Relationship 

There is no significant difference between the trained and untrained 
respondents' perceptions of their pupils' first responses to them. The percen- 
tages of trained and untrained in each response category in Figure 5,8 are very 
similar. About 50% of both groups found their pupils quite cooperative from the 
start of tutoring, while approximately one-third of both groups noted some 
hesitancy, but still found the children cooperative. From these data ji would 
appear that the Upswing volunteers had little difficulty establishing good re- 
lationships with their pupils. However, during interviews with children and 
their tutors, ORI discovered that a small percentage of volunteers had an in- 
accurate perception of the children's opinions of them. Although in some cases 
the volunteer thought the child had a lower opinion than actual, the majority of 
misperceptions were that the child was more positive than actual. 

Thus, in ORI's judgment, the willing cooperation and hesitant coopera- 
tion categories would in reality be almost equal at about 43%. This is still a 
remarkable finding, which, by itself, is an optimistic sign for Project Upswing's 
effectiveness. 

Table 5.4 indicates that the Denver and St. Louis volunteers may have 
found it somewhat easier to establish good relationships with their pupils. 
Comparing the percentages in the first two answer categories, the percentage 
who encountered "willing cooperation" is twice as great for Denver and three 
times as great for^St. Louis as the percentage who encountered "hesitant 
cooperation." The percentages answering in these categories are less different 
for Oxford and for San Francisco. However, the difference between willing and 
hesitant cooperation is not considered very important, particularly at the start 
of the tutoring relationship. The most important point to-be made from the data 
is that more than three-fourths of the respondents in all cities found the chil- 
dren cooperative from the start. Again it appears that, in general, the Upswing 
volunteers had little difficulty establishing comfortable relationships with the 
pupils they tutor. 
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Volunteer Comments About Their Relationships 



With the Children They Tutor 



"I have doubts as to whether I am helping him or merely 
increasing his negative feelings [about school].^' 

"My child is eager and ready to work and makes me feel 
as though he really needs me . " 

"I learn as much from the child as he does from me." 

"Both children are courteous and disciplined. Did not 
take long to establish a good relationship." 

"She was very affectionate and touched me before we were 
even introduced." 

"My pupil soon overcame a tendency to being shy, and is 
now very responsive." 

"He was on the defensive and rathej apprehensive. We 
are long over that hurdle." 

"We share a mutual liking for each other.*' 



{ 
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Volunteer-Teacher Relationship 

The volunteers were asked how they would assess the teachers' feelings 
about their tutoring assistance. The overwhelming majority of both the 
trained and untrained respondents checked "I feel that the teacher welcomes my 
assistance" (77% and 81%, respectively) . The data presented in Figure 5.9 
indicate that volunteer training made no difference in initial teacher response, 
at least no difference that the volunteers could detect in the early stages of 
tutoring . 

Table 5.5 permits comparisons by city on the same question. An 
average of^^79,%^5rirhe responding volunteers in all locations indicated they felt 
the teachers welcomed them. However, the St. Louis teachers appear to have 
been somewhat less favorably disposed than the teachers in the other cities. 
During the interviews in May, ORI lound that there had been communications 
and volunteer attendance problems that seemed to have caused some reserva- 
tions about the project among the St, Louis teachers. There were similar prob- 
lems in other cities, but the St. Louis teachers seem, to have been more bothered 
by them, perhaps because of the nature of the school system. ORI observed 
that the St, Louis schools, compared to those visited in the other cities, seemed 
to have a more traditional and less relaxed organization, with "closed class- 
rooms," the domain of a single teacher. Interruptions to the daily routine 
seemed to be more disturbing in this setting. It is stressed, however, that 
although some difference is evident between St. Louis and the other cities in 
degree of teacher responsiveniBss , on the whole the St. Louis volunteers seem 
to have felt their assistance was well-received. Seventy percent answered 
"teacher welcomes my assistance,'' while only 1%' (one volunteer) felt that the 
teacher resented her assistance. 

Figure 5,10 gives further indication of generally sqttisfactory volun- 
teer-teacher relationships (as perceived by the volunteers) . A majority of 
both groups of volunteers" indicated they were satisfied with the amount of 
teacher guidance they were receiving. 
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There is a significant difference, however, in the attitudes of the two 
groups. This difference is in the direction expected, based on the project design. 
It was planned that the trained volunteers would receive no guidance, as such, 
from the teachers (i.e. , although they might consult with the teachers from time 
to time, the trained people would plan tutoring activities on their own) . The 
untrained, on the 'other hand, were to be '* teacher-directed*' to the extent the 
individual teachers were inclined or had time to give direction (i.e., it was to 
be a "typical" school volunteer arrangement in which the teacher uses the help 
as she sees fit) . The response choices on the questionnaire obscure the issue 
somewhat, since all but one ("I do not need any guidance. . .") imply that at 
least some guidance was being received by all volunteers. However, based on 
the May interviews with a sample of volunteers , it appears that perhaps a 
m.ajority of both trained and untrained have had little substantive contact with 
the teachers (except possibly in Oxford) . Data from the final questionnaires 
should help to clarify this issue. In any case, it can be assumed that the 
trained people's apparently greater satisfaction implies that they tended to feel 
more self-sufficient than the untrained. 

The difference in opinion occurs largely in two response categories. 
A smaller percentage of trained volunteers felt the need for more teacher guid- 
ance, and a larger percentage said they did not need teacher guidance at all. 

The "would prefer more guidance" category is important in itself. Al- 
most a third of the untrained group expressed a need for more teacher support. 
Although the percentage of trained who expressed this need is smaller, it too 
is significant, particularly since it was planned that the trained should be able 
to work independently. 

From Table 5.6, it appears that more Oxford respondents prefer to work 
closely with the teachers than the respondents in the other cities . Although 
there is a suggestion that the San Francisco respondents may feel more indepen- 
dent than the others, the difference between San Francisco and Denver or St. 
Louis is so small that it should be discounted in the absence of supporting data. 
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One possible explanation for the trend in Oxford is related to the exis- 
tence or nonexistence of a school volunteer program prior to Upswing. Oxford 
had none. San Francisco has for years had a well-defined program (the San 
Francisco Education Auxiliary, or SFEA) that offers rather extensive training. 
Denver and St. Louis both have had programs for volunteers in the public schools 
for some time, although according to the information available to ORI, neither 
is so well established, organized, arid integrated with school life as the San 
Francisco program. The volunteer registration data, however, make this inter- 
pretation questionable. Table 3.8, on previous relevant experience, doe^ show 
Oxford with a smaller percentage of experienced volunteers (considering all 
types of experience combined) , but by only a small margin. 

Volunteer Comments About the Volunteer-Teacher Relationshi p 

--^v "She is cooperative now, at first she was not. She did not 
-. , know what the program was about." 

"I would like to see a little more help given to the teachers 
from the Project staff so they may better understand the 
role of the volunteers and how to use them effectively." 

"I feel that very close cooperation between teacher and 
' . tutor is essential so that they don't work against each 
other." 

"She has been wonderful and has given me so much help 
^ in understanding their reading program." 

[Teacher welcomes volunteer assistance] "But is a little 
suspicious, mainly of my qualifications." 

"She has been very receptive and helpful, and thinks the 
individual instruction valuable . " 



Volunteer Attitudes Toward the Task of Preparing for Tutoring Sessions 

The data displayed in Figure 5.11 indicate that almost 100% of both 

the trained and untrained respondents were putting some effort into preparing 

3/ 

for their work as tutors. Only 2% of all respondents (2% of the trained and 
3% of the untrained in the figure) said they felt preparing for tutoring was time- 
consuming and unnecessary. Moreover, the overwhelming majority of both 
groups said they found the preparatory effort useful and interesting. Clearly, 
training status made no difference in the respondents' attitudes. 

Table 5.7 shows a similar distribution of attitudes by city. Close to 

100% of the respondents in Denver, Oxford, and San Francisco, and 88% of txhose 

3/ 

in St. Louis, indicated that they do prepare for sessions held with their pupils.— 
Again the overwhelming majority in all cases said they find the task both useful 
and interesting. The San Francisco people tend to show more enthusiasm for 
preparing and the St . Louis people slightly less than those in Denver and Ox- 
ford; however, tfese differences are small. The difference between the-" extreme s , 
St. Louis and San Francisco, is fairly considerable. St. Louis's trained vol- 
unteers were required to turn in a lesson plan for each tutoring session. It 
may be that reaction against this requirement is reflected in their somewhat 
less enthusiastic group response. In any case, it is not considered of major 
importance in view of the overriding points that a very strong majority of vol- 
unteers in all locations apparently prepare for the work and find the preparation 
rewarding. 



3/ 

— Based on the combined responses in the first two categories. 
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7. I feel that preparing for tutoring sessions 

is: (check one) 

a. A useful and interesting part of 
volunteering □ 

b. Necessary but tedious work □ 

c. Time-consuming and unnecessary □ 



10% 




Preparation 
Useful and 
Interesting 



Preparation 
Necessary 
but Tedious 



□ 



Trained 



Untrained 



2% 



3% 



Preparction 
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FIGURE 5.11. TRAINED AND UNTRAINED VOLUNTEERS' ATTITUDES TOWARD THE 
TASK OF PREPARING FOR TUTORING SESSIONS, ALL CITIES 

(Nonresponse to question: 2% trained, 5% untrained; total 3%.) 
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Volunteer Comments' About Preparing^ for Tutoring 



"It is more time-consuming than I had expected," 

"The preparation is as exciting as the tutoring itself." 

"I would certainly hesitate using a child*s time if I had 
not prepared to try and give him something," 

"I don't mind the' preparation I do, but I don't know if it 
is what should be done or not." 

"It is hard to make lesson plans when the reading material 
to be used is not available for us to take home t6 study." 

"As far as I am concerned preparation is the key to success. 
I feel that each lesson must be prepared on the basis of the 
evaluation of the previous lesson." 

"I dislike lesson plans intensely, and find that my student's 
rebelliousness makes them worthless." 

"One must be prepared if you wish to be effective." 

"Preparation is necessary but lessonjplans are not strictly 
adhered to since my pupil's interes#^pan is short and un- 
predictable." 
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Assessment of the Difficulty of Tutoring 

Sixty-nine percent of the trained and 58% of the untrained respondents 
indicated that experience upheld their expectations about the difficulty of tutoring 
Equal percentages of untrained, and roughly equ'al percentages of trained, found 
tutoring more and less difficult than they had anticipated. There are small dif- 
ferences between the percentages of trained and untrained in all response cate- 
gories; however, they are not statistically significant /(Figure 5.12.) 

Table 5.8 presents the above data by city. Sixty percent or more of 
the respondents in all locations indicated that they had accurately assessed the 
difficulty of tutoring. The percentages on either side of the mode response are 
roughly equal for Denver and Oxford. There is, however, some difference in 
these percentages for St. Louis and San Francisco. It is not a great difference 
in either case, but it is interesting that the higher percentage of St. Louis volun- 
teers found tutoring easier than expected while the higher percentage in San 
Francisco found it more difficu-t than expected. This switch in weight of opinion 
makes the difference more noteworthy. Tt may be that the San Francisco respond- 
ents as a group encountered somewhat more difficulty in tutoring than the St. 
Louis respondents, or training in either city may have given an inaccurate im- 
pression of the difficulty of the job. Nevertheless, based on the recent inter- 
views, OR! cannot make accurate interpretation of the respondents* motives with- 
out further information. Looking at the^data by city, as well as by training status 
of volunteers, the most impiortant point to be jtaken is that the overwhelming 
majority of those people who did not drop out of the project early found tutoring ^ 
as they had expected it to be or easier. 
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Volunteer Comments About the Difficulty of Tutoring; 

"Volunteers for thl's project should be screened carefully. 
All are not capable of teaching children regardless of their 
good intentions. It takes more to produce results." 

"Insofar as any training for such a short time can't possibly 
make a volunteer feel comfortable I am mostly aware of what 
I don't know. " 

"Frustrating more than difficult." 

"Most interested middle-aged mothers have sufficient in- 
sight. Others may need training , depending on background." 

"I'm having so much fun I'm afraid it can't be right! (Puritan 
ethic) " 

"The most important thing to remember' is HAVE FUN." 



5-40 



General Satisfaction With Role as Volunteer Tutor 

Several of the questions on the first impressions questionnaire were 
included for their value as indicators of role satistackion as well as for infor- 
mation on more specific issues (namely, the questions dealing with volunteer- 
pupil relationship, volunteer-teacher relationship , preparation for tutoring 
sessions, and i-he actual difficulty of tutoring in relation to expected difficulty) . 
The idea was that these data would support a general expression of satisfaction, 
if that were found, or, on the other hand, would suggest reasons for general 
dissatisfaction. The responses to these questions are strongly positive, as are 
the responses to the role satisfaction question. 

Figure 5.13 shows that the respondents tended to be quite satisfied 
with their. tutoring role. It also shows that training had no bearing on their 
degree of satisfaction at the time they completed the first impressions question- 
naire. Only a negligible percentage of either group indicated tbey were dissatis- 
fiea. Approximately two-thirds of both checked "satisfied," while. about another 
third of both checked "partly satisfied." 

Some of the volunteers with mixed feelings commented on their reasons, 
which were various. One volunteer said she felt they should receive carfare for 
commuting to and from school. Threa people said they had so many other obli- 
gations that the commitment to Upswing was more than they could comfortably 
handle. A fairly common reason was that the volunteer felt uncertain of her 
ability to help the child. In a few cases, volunteers already felt disappointed 
in the results of their tutoring efforts. Few comments on the role satisfaction 
question were explicit complaints about the project. Such comments were made 
in response to other questions, or in the general comment space, when made. 

From Table "5. 9, the Oxford respondents indicated a significantly higher 
level of role satisfaction than those frorn Denver and San Francisco. There is 
also a tendency, although somewhat lecf.s pronounced, toward greater satisfac- ; 
tion among the St. Louis respondents. It should be remembered, however, that • 
the majority in all cities fall in the highest category of satisfaction, and less ; 
than 5% in all cities fall in the "dissatisfied" category. 
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Volu nteer Conments Related to Role Satisfaction 

'Tm having a wonderful; interesting and challenging exper- 
ience working as an Upswing volunteer." 

"Challenging, frustrating and rewarding." 

"I feel that it's a rewarding project for me. I'm accom- 
plishing something important." 

"L,Wonder at times just how much I am getting across, and 
if what I am presenting is what he needs," 

"Progress seems slow. I would like to be able to accomplish 
more." 

"I wonder how effective I am in this role and so in this way 
I feel I am at least helping others determine the effective- 
ness of volunteer tutors." 

"I sometimes feel at a loss as to how to deal with this 
child. " 

"I would be more satisfied if I felt more confident in my 
ability to help James make major progress ," 
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TEACHERS' FIRST IMPRESSIONS OF PROJECT.,.,UPSWING 

Parameter^' of the Population 

The data presented here represent the first impressions of 90% of the 
teachers participating in Upswing; 112 out of a total population of 130 teachers 
returned questi-onnaires . By city, the response rates are: Denver, 96%; Oxford, 
89%; St. Louis, 100%; and San Francisco, 76%. Thus the data on teacher im- 
pressions can be considered representative of the total population and of the 

V 

individual project population in all cities.— 

Special Considerations About the Da ta 

Please note that many teachers have more than one pupil receiving 

assistance from an Upswing volunteer (the range was from 1-15 pupils at the 

time the first impressions questionnaires were completed) . In the figures and 

^^les dealing with observations of specific children (Figures 5.15 to 5.17 and. 

"^I^SBles 5. 11. to 5.13) ,.the totals are totals of children reported on by teachers, not 

numbers of responding teachers,- and the percentages are based on the numbers 

5/ 

of children. In these cases N = 242 for the project at a whole.— 

T^^data on the children offer only a rough indication of what changes, 
if any, were observed in their achievement and behavior/attitude toward school. ' 
Complete attrition data on volunteers ar/i children were not returned to QRI so that 
we could accurately determine how many children were involved in the project 
in January 1972. The total of 242 reported on by teachers in the first impressions 
questionnaire seems low, at least for that stage of the project. On a by-city basis. 



1/ 

5/, 



The San Francisco .response is considered good, although not so outstanding 
as the response from the other cities . 



The design of Project Upswing called for 100 children to be tutored in each city, 
50 by trained volunteers and '50 by untrained volunteers. Not all of these chil- 
dren were assigned a volunteer (only Denver registered its volunteer quota of 
100) , nor did all volunteers who wer assigned continue tutoring until January 
1972, when the first impression forms were distributed. Some never even be- 
gan tutoring. This resulted in teachers not being able to comment on all chil- 
dren who were to have-received assistance. Data are available on ^ total of 
242 children rather than a total closer to 400 (allowing for teacher nonresponse) 
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the Denver and St. Louis numbers of children are more in line with OKI's expec- 
tations than the Oxford and ^^^^Francisco numbers. 
Teacher Initial Opinion Summ'SiV 

• The Upswing teachers seem to have positive general 
attitudes about the project's worth. Close to two-- 
thirds of those responding said they believed Project 
Upswing would benefit most of the children involved, 
and 34% said th^ey believed it would benefit some of 
the children involved. 

• With regard to specific project eff^s, the teachers 
saw improvement in the reading ability of slightly 
more than half of the children on whom they reported. 
They saw less improverr^nt in behavior or attitude 

toward school— 39% of the children were said to have 

made gains in these areas. 



The teachers indicated that 76%'-of the children on 

whom they reported liked their Upswing volunteers 

j 

and only 1% (three children) disliked their 
volunteers . [ 

Close to half of all responding tea dhe rs said they 
knew nothing about the training given to Upswing 
volunteers. (Many te|^ers were assigned both 
trained and untrained volunteers, and this half does 



ri^pfepresent only teachers who had untrained.) 
Teacher willingness to work with Upswing volunteers 
again is indicative of favorable attitudes toward the 
project. Seventy-one percent said they would like 



which ideally would have been the case. ORI cannot say at this point whether 
the 242 were in fac*: all of the responding teachers' pupils who were receiving 
assistance fronr. 'J p swing volunteer? at the time or whether the responding 
teachers failed to report on all o': ^h.^ / :j\nlls who were receiving assistance. 
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Upswing volunteers to tutor their pupils next year. 
Tc. percent" said they would not like it, and 18% 
were undecided at the time. " " 

Teacher impressions generally are similar from city 
to city. One possibly important difference is' that 
St. Louis and San Francisco teachers were signifi- 
cantly less well-informed about volunteer training 
than the teachers in Denver and Oxford. Another 
noteworthy difference is difficult to interpret at this 
time. The majority of Denver teachers said that 
they thought Upswing would benefit most children 
ihvolved and that they would like to have Upswing 
volunteers work with their pupils next year. How- 
ever, the Denver views on these points were rfot as 
strorifefly positive as the views in other cities (par- 
ticularly on the latter point— only slightly over half 
wanted Upswing volunteers again) . On the other 
hand, Denver teachers observed irp^rovement in the 
tutored children more often than the teachers -in any 
other city. 

f 
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Teacher Opinions About Project Upswing's Potential Effects on Children 

The teachers, as well as the volunteers, seem generally to have felt 
that Project Upswing would prove to be worthwhile. Approximately two-thirds of 
the teachers felt that most children participating in the program would benefit 
from the extra help^ while about a third felt that only some would benefit (Figure 
5. 14) . Table 5. 10 shows a similar division of opinion in all of the cities. The 
percentage who felt the project would not be beneficial to any children is low 
in all locations and for the total population. Denver teachers appear to have a 
slightly less favorable view of the project's general value, based on the lower 
percentage there (58% versus 63%/ '68%, and 65% in the other cities) who said 
Upswing would benefit most children and the higher percentage who said it 
would benefit no children (7% versus 0%, 4%, and 0% in the other cities) , 

Teache ; Comments About Project's Potential Effects on Children 

"I have watched with great interest the beneficial impact 
each visit of the volunteer has had upon the pupil involved. 
I only wish that at least 50% of my class could share in this 
morale -boosting technique. To favorably alter^a'chiid' s 
impression of self is to gain great stride in a learning program." 

"I think it can only benefit the children." 

"In my own case, I felt the program had great potential — 
but after a very disappointing experience I tend^to ques- 
tion its value," [Volunteer came Irregularly, then dropped 
out,] 

"I feel that thj,s project has been a great help to the school. 
A,,, Many many children have benefited through this project. I 

■ would like to see the project continued/' 

"For the amount of time and people involved in this pro- 
ject, I do not feel that a meaningful growth in the children's 
development is taking place."/ 

. "Because of its value, such a program would be an asset to 
any classroom . " 

"I cannot praise the idea behind the Upswing program too 
highly. For children who are retarded for any reason the 
Upswing policy gives them self-importance and enough 
self-confidence to attempt to learn to succeed in school 
work— to many, a fresh and new concept." 
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V 



My first impression is that Project Upswing 
will: (check one) 

a. Be beneficial to most of the 

children participating □ 

b. Be beneficial to some of the 

children participating □ 

c. Not be beneficial to any of the 
children participating □ 
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FIGURE 5.14. TEACHER OPINIONS ABOUT UPSWI'NG'S 
POTENTIAL TO HELP CHILDREN, ALL CITIES 
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Teacher Observations of Changes in Children Since Tutoring Began 

Figure 5.15 indicates that the teachers saw improvement in the reading 
- ability of over half of the children they reported to be involved in Upswing at 
the time the first impressions questionnaire was completed. They saw no change 
in the reading of aboLt onL-third of these children, and a decline in the reading 
of 3% of the children. 

Looking at the same data by city (Table 5.11), it appears that roughly 
half of the tutored children in St., Louis and San Francisco may have made gains 
in reading since, the start of tutoring, while 57% of the Oxford children and 64% 
of those in Denver may have made gains. The least improvement was noted in 
San Francisco, where the teachers indicated that slightly more than half of the 
pupils demonstrated no change in reading ability. Again it is stressed that 
teachers may not have reported on all of their pupils who were being tutored at 
the time. It could be, for example, that the 53- children assessed by Oxford 
teachers actually represent only a little over half of the Upswing child popula- 
tion there. This is not likely, but it is possible. 

From Figure 5.16, the Upswing teachers indicate that the children's 
behavior V)r attitudes toward school tended to remain the same from the start of 
' tutoring to the time the first impressions questionnaire was completed. They 
saw no change. in about half of the children , versus invprovemQ.nt in the behavior/ 
attitudes of about one-third. In Table 5.12 we see that Denver teachers observed 
■ - " more improvement in behavior or attitude toward school (47% of the children 

improved, 40% remained the same, and 5% declined) than the teachers in tjie 
other cities. St. Louis teachers observed the least (32% of children improved, 
56% remained the same, 8% declined) . The Oxford and San Francisco teachers 
also indicated th?t mor^ children remained the same than improved. The ques- 
tion arises whether ther^ AA^a^s-need for improvement in the behavior or attitudes 
of the children . OKI's interviews indicated that in a sizable number of cases 
there was need. Nevertheless, improvement in; behavior is not highly cone- 
lated with" increase in self-esteem or reading. In fact, during ORPs interviews, 
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Please indicate any changes you have 
noticed in the reading of the Upswing 
pupils since they began working with 
the tutors. (Response choices were: 
Improved, Remained the same. 
Declined)' 
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FIGURE 5.15. TEACHER OBSERVATIONS OF CHANGE IN 
CHILDREN'S READING ABILITY, ALL CITIES 



(Nonresponse to question: 4%.) 
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Please Indicate any changes you. have 
noticed in the general behavior/attitude ' 
toward school of the Upswing pupils 
since they began working with the tutors, 
(Response choices were: Improved, 
Remained the same. Declined J 



51% 



39% 



4% 



..Ti proved 



Declined . 



I 



Remained 

the Same f 

i' - / 

FIGURE 5.16. TEACHER OBSERVATIONS OF CHANGE 
IN CHILDREN'S BEHAWOR/ATTITUDE TOWARD j 
SCHOOL, ALL CITIES ! 

(Nonresponse to question: 6%.) { 
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it became apparent that in several cases self-esteem and reading achievement 
increased, but school attitude and behavior in class became difficult for the 
teacher to handle. This point will be clarified by data from the final question- 
naire, provided that the response rates are high enough. 

Teacher Comments About Changes in the Children Since Tutoring Began 

"Both of the students have certainly grown. Their attitudes 
are excellent. It's too bad that testers don't measure 
g^iteral attitude or behavior. These children had very little 
ihterest for learning when school first started; now they 
h^e a great interest for learning to read." ' ^ 

"This program has been very helpful to a little boy whose 
name was chosen. He is no longer withdrawn, but has 
become active with his peers." 

"The ones who are being tutored have shown marked 
improvement . " 

"These children who have been helped are, in general, 
making improvements — socially , intellectually, and 
emotionally. " 
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Teacher Assessment of Children's Responses to Volunteers 

According to the teachers, 76% of the Upswing children reported on . 
liked their volunteers at the start of tutoring. Only 13% of the children showed 
no reaction (were, "neutral") , and only ]% cnowed hostility (Figure 5,17) . Table 
5. 13 shows that on an individual city basis as well, a large majority of the 
children (an average of 76%, with a range from 72% in Oxford to 84% in Denver) 
showed positive attitudes toward their volunteers. 

Teacher Comments on Children's Responses to Volunteers 

"I don't know how it worked with the children, because none 
of my tutors came." 

"Some of the children ask every day if 'their' Project Upswing 
volunteer is coming today because they have something to 
show them or just generally want to see their special person." 

"My students all enjoy their work with their tutors and look 
forward to having them come." 

"There was a problem in that the aide Clinton was assigned 
to was not good for him. She might have worked out with 
another child. Thus, mis-matching can be a serious problem." 
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FIGURE 5.17. TEACHER OBSERVATIONS OF CHILDREN'S 
RESPONSES TO VOLUNTEERS, ALL CITIES 
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Teacher Opinion of Volunteer Training 

The most important point ^o be made about Figure 5.18 is that almost 
half of the teachers said they knew nothing about the training given to volun- 
teers. Forty-one percent thought that it was either excellent or adequate, and 
10% found it inadjQguate . On a by-city basis, the St. Louis and San Francisco 
teachers were significantly less well-informed about volunteer training than the 
Denver and Oxford teachers (Table 5.14) . About two-thirds of the St. Louis 
and San Francisco teachers had no idea what training was offered to the volun- 
teers, versus 25% of the Denver teachers and 37% of those in St. Louis. 

The original project design statement says that, "hopefully, [teachers] 

will not know to which experimental group. . .Upswing pupils have been 
6 / 

assigned."-- This means that the teachers "hopefully" would not know whether 
their pupils were assigned to trained or untrained volunteers, and it implies 
that teachers probably would not know what was included in the training. There 
is an inconsistency here with another aspect of the project design, or at least., 
with its interpretation. It was assumed that the untrained volunteers would work 
more closely with the teachers than the trained, that they would be "teacher- 
directed" to tha extent the teachers were willing and able to give direction, ORI 
had not been brought into the project at the time these plans were made ^nd has 

never understood this apparent conflict: How could teacher^ give more direction 

7/ 

to untrained volunteers if they did not know who was untrained?-** In any case, 
the plan was not practical, because teachers and volunteers meet. Many 
teachers , perhaps most, knew the training status of the volunteers assigned to 
their pupils, and, as can be seen in Figure 5.18, about half of the responding 
teachers knew enough about volunteer training to have an opinion about it. 

— U.S. Office of Education, Report From Project Upswing Directors' Meeting, 
May 17-18, 1971 , p. 1. 

7/ 

"-'^ There is further confusion because the Project Upswing Summary (pp. 7,8) 
also issued by the U.S. Office of Education (no date given) , stated.that one 
goal of the project was "To provide an interchange of ideas and support with 
the classroom teacher and volunteer," and, further, that "The training sessions 
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Given that the project design did not require that the teachers be in- 
formed about the exact nature of the training given to volunteers, Upsw^ing was 
to be explained to them. It would be reasonable for teachers to be told generally 
v;hat materials and techniques the trained volunteers were prepared to use, even 
though the trained were to work independently. A fairly frequent comment in 
teacher interviews during ORPs recent visits to the cities was that teachers 
should be informed about volunteer training. The city project directors agreed 
on this point as early as the January 1972 meeting in Washington, and a require-- 
ment was established that the content of volunteer training would be one topic 
covered in the workshops to be held for Upswing teachers before the 1972^73 
project gets under way. 

Thirty percent of the teachers did know something about the training, and 
considered it adequate, while 11% considered it excellent and 10% found it 
inadequate (Figure 5 . 18) . From Table 5. 14, it appears that there may have 
been some tendency for Denver teachers to have a lower opinion of volunteer 
training than the Oxford teachers . Eighteen percent in Denver found it inade- 
quate, while none in Oxford found it so. In addition, a somewhat higher per- 
centage of the Oxford teachers r^.ted the volunteer training as "excellent" 
(19% versus 13% in Denver) . 

Teacher opinions concerning the adequacy of volunteer training would 
have to be based almost entirely on observation of the tutored children in the 
classroom rather than on analysis of training content and execution or of volun- 
teer performance during tutoring sessions. ORI sought these opinions to obtain 
a rough measure of teacher attitudes toward volunteer competence. 



for the volunteers will also be scheduled so that the teachers may participate 
if they so desire." (As far as ORI knows, teachers were not invited to the 
volunteer training sessions in any city.) From this, it would seem the 
teachers were to know the training status of volunteers and the content of the . 
training given. 



ERIC 



5-63 



Teacher Comments About Volunteer Training 

"I'm not sure the training in special methods has been 
particularly helpful." 

"The volunteers work very well with the children, but 
I don't know what the training was. " 

"Volunteer trained [sic] need more direction and super- 
vision than teacher directed volunteers." 

"I would like to see them use a few more materials 
related to our reading program ." 

"I think teachers should know what training has been 
given . " 

"Bon^t know v/hether our aides are trained or not. Also 
don't know hoW they were trained." 
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Teacher Attitudes Towards Working With Volunteer Aides 

A general question about teacher attitude toward volunteer assistance 
was included on the first impressions questionnaire in an attempt to get an 
unobtrusive check on teacher attitude toward Upswing volunteers. It was 
thought that positive general attitude might support and help explain positive 
attitude toward Upswing volunteers, should those be the findings. On the 
other hand, negative general attitude might, in part, explain negative attitude 
toward Upswing volunteers. However, no clearly valid interpretation can be 
made of general attitude toward working with aides because it appears from 
the comments on the question that teachers interpreted it in more than one 
way. 

In Figure 5.19 it is seen that 84% of the total population said they 
felt most teachers welcome volunteer assistance, while 10% felt that most pre- 
fer to handle their classes alone . (Six percent did not answer the question, 
many of them indicating that they could speak only for themselves on this 
issue.) These responses are reasonably consistent with the responses to a 
specific question on teacher willingness to work with Upswing volunteers in the 
next school year (see Figure 5.20) . It should.be noted, however, that many 
teachers qualified their responses to this question in the comments space pro- 
vided. Most frequently, they wrote that an aide is welcomed if he or she is 

dependable and/or effective, or if there is a need for an aide ("it depends 

) 

on the class"), or that "it depends on the teacher." 

Table 5.15 raises questions about these data. The results for Denver, 
Oxford, and St. Louis are relatively consistent, with Oxford and St. Louis 
teachers showing the greatest enthusiasm for volunteer assistance. Less than 
10% of the teachers in those cities said they felt most teachers prefer to. work 
alone (7% in Denver, 0% in Oxford, and 4% in St. Louis) . In San Francisco, 
however, 27% (seven teachers) said they felt most teachers prefer to work 
alone. ORI checked the San Francisco comments on this question and found 
^ that four of the seven teachers who responded "negatively" noted that, while 
they^felt most teachers prefer to work alone, they personally welcome volunteer 

5-65 

O 

ERIC 



o 



O 

Q> 
V) 

C 

o 
a 

Vi 

a> 
GC 

c 



100 T 



90 



80 " 



70 



60 



50 



40 



30 



20 



10 



10% 



I feel that: (check one) 

a. Most teachers prefer to handle 

their students alone □ 

b. Most teachers welcome 

volunteer aides □ 



84% 



Most Teachers Prefer 
to Handle Class Alone 



Most Teachers 
Welcome Aides 



FIGURE 5 • 19 . TEACHER ATTITUDES TOWARD WORKING 
WITH VOLUNTEER AIDES, ALL CITIES 



(Nonresponse to question: 



6%.) 



ERIC 



5-66 



< 



1—1 

u 

CO 

w 
Q 

Pi 
w 
w 

H 
IS 

!=) 

O 
> 

H 
I — I 

>^ 

r- 

o 



C3Q 



O 



o 

H 



O 
O 
cn 

o 
c 

CO 



o 



CO 



O 

O 



n9 












rH r-H 


CD 


CO 



o o 



Cs3 O 

r-H O 





nP 


Np 








LO CO 


LO 




o 


CN3 


r-H LO 


r-H 


CM 


o 











nP 
CM CD 



nP nP 

O O LO O 
O CM O 



nP 
O 

o 



o 



fS) o 

r-J O 



P 

< 

H 

CO 
W 

Q 

H 

y—t 

H 
< 

a:, 
w 

< 



> 
Q 



CD 



CD to CO [>- 
CO 00 



" 0 

0 

^ o 2. 

fO 0 CO 
0 fO 

tn a O 
O 



0 

x: 
o 



U3 
0 

0 
o 



0 u 
^ 0 

O 



o 



0 

CO 

c: 
o 

a. ^ 

O 

2 



LO O 

o 



+-» 

O 



5-67 



assistance. Since it is evident from the comments that answers may have been 
based on inconsistent reference points, a valid interpretation of this difference 
between city populations, other than that the difference is an artifact caused 
by a poor choice of question, cannot be made . 

Teacher Comments on Working With Volunteer Aides 

"Volunteers only come at their convenience/* [This teacher 
felt most welcome paid aides . 1 

"Many teachers would like the aides but 4o not want to 
bother with additional paperwork necessary in a special 
program/' 

"Teachers welcome aides if the aides reinforce what the 
teacher is doing." 

"I do not believe any teacher has time enough to do all the 
things she wants to do with all the children. An aide is an 
invaluable asset." 

"Depends on teacher." 

"I welcome mature, aware women who do not take up much 
of my time, are self-starters and get along w^ftl with the 
children, only." 

"The only problem I have found is that some volunteers have 
not been dependable." 

[Teacher likes working with volunteers] "Only if the volun- 
teers were prompt and consistent in their visits." 

"If they do not disturb and interrupt the class. If they are 
dependable." 
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Teacher Willingness to Work With Upswing Volunteers Again 

Figure 5.20 shows that 7 IX of the respondents said they would like 
to work with Upswing volunteers in the next school year. Eighteen percent were 
undecided at the time the questionnaire was completed, and 10% said they were 
not willing to work with Upswing volunteers again. 

From Table 5.16, Oxford teachers most often had positive feelings 
about working with Upswing volunteers: 88% said they would like to do so 
again and none said they would be unwilling to do so. The St. Louis responses 
are only slightly less positive, with the difference being that 8% of the teachers 
there said they would not like Upswing volunteers again next year. About three- 
fourths of the San Francisco teachers answered the question positively. Only 
4% answered negatively, and 19% were undecided.—'^ 

Table 5.16 shows some difference in the attitudes of Denver teachers 
toward Upswing volunteers . If the data in Table 5 * 15 can be accepted as valid 
indicators, their general attitude towards working with aides is quite positive — 
86% said they felt most teachers welcome aides. However, only 58% (26 teachers} 
said they would like Upswing volunteers to work with their pupils again next 
year, while 18% (8 teachers) said they would not and 24% (11 teachers) v/ere 
undecided. This distribution of opinion is particularly interesting in view of the 
fact that the Denver teachers noted more improvement than those from the other 
cities in the reading ability and behavior/attitude of children since tutoring 
began . 

ORI reviewed the questionnaires completed by the 19 Denver teachers 
who'were undecided or said they did not want Upswing volunteers again. Seven- 
teen commented on their reasons as follows: 



It should be remembered that the San Francisco responses are less reliable 
than those from the other cities as indicators of the attitudes of the total 
city teacher population because of a lower response rate . The margin for 
error is increased slightly in this case because 4% of the San Francisco 
teachers did not answer the question about willingness to have Upswing 
volunteers tutor their pupils next year. 
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Volunteer not dependable 



about coming to tutor. 



Teacher does not have 



enough time to work with 



volunteer. 



6 



It is not good for the child 



to miss class • 



2 



Project Upswing is poorly- 



coordinated. 



2 



It disrupts class to have 



people coming in and out. 



1 



Thus it seems that there was no single / overriding reason for misgivings 



about Upswing. It should be noted that comments of these kinds were made by- 
teachers in all cities, including some who said they would like Upswing volun- 
teers to work with their pupils next year. 

Teacher Comments About Working With Upswing Volunteers Again 
^ "Undecided because of poor [project] coordination." 



"If they are dependable." 

"Any volunteer who wants to help foster a child's growth 
is always welcome in the educational life of that child." 

"I would like to use them only if they can be all trained 
and responsible tutors." 

"Any added instruction just has to be helpful." 

"The volunteers assigned to me have been most reliable, 
pleasant and helpful." 
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COMPARISON OF SELECTED VOLUNTEER AND TEACHER FIRST IMPRESSIONS OF 
PROJECT UPSWING 

Hi- ... 

The teachers, as well as the volunteers, appear to have had generally 
positive first impressions of Upswing. Below is a comparison of the two popu- 
lations' opinions of the project's potential to help children, of volunteer-child 

9 / 

relationships, and of volunteer-teacher relationships.— In the referenced • 

figures presenting volunteer opinion, percentages are given by training status; 

they were averaged for this volunteer-teacher comparison. 
H 

• The majority of both teachers and volunteers (63% 
and 74%, respectively) said they believed Project 
Upswing would be beneficial to most of the chil- 
dren participating. Only a negligible percentage of 
either population believed Upswing would be bene- 
ficial to no children. (Figures 5 . 2 and 5 . ]4 .) 

• Both teacher and volunteer opinions support the 
conclusion that, generally, volunteer-child rela^ 
tionships were good. The volunteers indicated that 
they had little difficulty in establishing a positive 
relationship with the children (83% said the chil^ 
dren responded to them with willing or hesitant 
cooperation) . The teachers stated that 76% of the 
children on whom they reported liked their Upswing 
volunteers. (Figures 5.8 and 5.17.) 

• The teachers' willingness to work with Upswing 
volunteers next year is an indication that despite 
any problems that may have arisen in the project, 
the teacher-volunteer relationships were generally 

ORI had planned to compare teacher and volunteer opinions about the 
adequacy of volunteer training. This was not possible because, as shown 
in Figure 5.18, 45% of the teachers said they knew nothing about it. 
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satisfactory. Seventy-one percent of the teachers 
said they would like Upswing volunteers again. The 
volunte.:^rs also seem to have found their relation- 
ships with teachers generally satisfactory. Close to 
80% of the volunteers felt the teachers welcomed 
their assistance, and 61% felt they were receiving 
adequate guidance from the teachers. (Figures 5.20, 
5.9, and 5. 10.) 



DENVER PARENTS' FIRST IMPRESSIONS OF PROJECT UPSWING 

This subsection includes data from Denver parents only. So few ques- 
tionnaires were returned b/ the parents from the other cities that nothing can be 
said about them (see Section I discussion of questionnaire handling and response 
rates, page 1-5) . About 56% of the Denver parents responded. The 56% rate 
is taken as a "worst-case" because there is no way of determining e'xactly how 
many parents received forms. They were sent by the city project office to the 
schools for delivery to parents by the children. The completed forms were 
returned to the Denver office via the same route and then sent to ORI . The 56% 
figure is based on the number of Denver children who, according to ORPs data, 
should have been working with volunteers at the time— that is, 113 children, — ^ 
(Our records show that 116 children in Denver originally were assigned volun- 
teers. We were informed by the project office that three volunteers dropped out 
and were not replaced. The records on their three pupils were removed from 
ORPs data file.) The Upswing office in Denver was not aware of all volunteer 
attrition; however, the teachers were, and they very likely did not give the 
forms to children who nt^vsr were tutored or whose tutors had stopped coming. 
The Denver teachers reported on 76 childreip in their first impression question- 
naires, and, as stated in Section III, 75 Denver volunteers returned first im- 
pressions questionnaires. These people were regarded as 69% of the actual popu- 
lation although they may have been a larger percentage. ORI does not have 
attrition data to clarify this matter. 



In the Section II presentation of Denver children's background character- 
istics (data from the parent registration form), ORI used 110 as the base 
for computing the response rate. That was the only figure available for 
the population size about the time tutoring began. The number of children 
receiving Upswing tutoring changed frequently over the life of the project. 
It took some time for the volunteer-child assignments to be completed. 
Simultaneously, attrition was altering the total. 
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Parent Initial Opinion Summary 

• Only four of the 63 Denver respondents attended the 
parent orientation meeting (held November 18, 19 71 
on the university campus) • About 30% of those who 
did not attend wrote in the comments space that they 
did not know such a meeting took place, 

• The overwhelming majority of respondents indicated 
that they felt Upswing was a good program that would 
benefit their children. 

» They also said that their children appeared to enjoy 
working with a volunteer and appeared to enjoy re- 
ceiving sDecial assistance. 

• They indicated (again by an overwhelming majority) 
that they feel parents should be involved in their 
children' s' education and should work with them 

"regularly at home. 
It is stressed that the findings summarized above, and described sub- 
sequently in more detail, should not be extrapolated even to the total population 
of Denver parents. It is highly possible that the sizable percentage 'of parents 
who did not respond would have different views about the project and the degree 
to which parents should be involved in their children's education. The most that 
can b.e said is that 90% of the respondents represent at least 54% of the total 
population of parents whose children were being tutored at the time the first im- 
pressions forms were filled out. Thus any 90% or greater consensus represents 
a ..majority view e 

General Attitudes Toward Upsw ing 

Table 5.17 gives the responses to two questions designed as indicators 
of parent attitude toward the project. An overwhelming majority (9 4%) of the 
parents in Denver were glad their children were selected to participate. More- 
over, 81% believed Upswing would probably benefit the children. 
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Children's Attitudes 

Most of the responding parents (76%) believed their children were en- 
joying the special assistance from Upswing volunteers, although a sizable- group 
(18%) were unsure— the children had expressed no feeling about it (Table 5. 18) . 
Ninety-two percent of the respondents said the children liked the volunteers 
with whom they worked . 

Parent Involvement in Child's Education 

The first impressions questionnaire included a three-part question 
aimed at determining the extent to which Upswing parents believed they should 
be involved in their children's education. In Table 5.19 we see that the Denver 
respondents, at any rate, endorse an active role for parents. The extent to 
which they actually are involved in their children's education is not documented. 
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Volume II 



Analysis of Tutoring Result 
and Final Impressions 



L INTRODUCTION 



PURPOSE AND CONTENT 

Volume I of this report, published in July 1972, presented an over- 
view of Project Upswing's first-year design, and profiles of the major groups 
of participants— children, volunteer tutors, and teachers. It was established 
in Volume I that the control group and the two experimental groups of children 
were comparable in number and in characteristics measured by an initial test 
battery: IQ, level of visual-motor integration, and level of reading skill 
demonstrated on the Wide Range Achievement Test (WRAT) . It was also 
established that the trained and untrained volunteers were comparable on 
various socioeconomic indicators (education, experience, socioeconomic 
status, etc.) and initial attitudes toward the project, tutored pupils, and 
teachers. Differences between the trained and untrained volunteers were 
;.; rioted in age and a related characteristic, student status. 

Starting from these baselines. Volume II presents the analysis of 
tutoring outcomes: what happened to the children over the-tutoring period; 
and of the many variables involved that ORI was able to measure, which 
appear to have been related to the results of tutoring. These are the questions 
of prirnaiy concern. In addition, this part of the report also explores aspects 
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of the volunteer-teacher relationship, their role satisfaction, their opinions 
of Upswing, and volunteer training variables that appear important for those 
planning and managing a project like Upswing. 

DATA SOURCES 

All data presented in Volume I (see "Data Sources," pages 1-4 and 
1-5) went into the analysis described here. Results of the final round of 
testing and end-of-year impressions of the project obtained from final project 
questionnaires complete the information for evaluation. The final test battery 
was identical to the initial battery except that the IQ test and vision and 
hearing checks were omitted. 

DATA HANDLING 

Child Test Data 

The administration, scoi-ing, and recording of the final tests were 
done just as in the initial round. The final battery was administered in 
May 1972 in all cities. QRI received all test results by the end^ of July 1972. 

Final Impressions Questionnaires 

Forms were distributed by QRI directly to volunteers at their homes 
and to teachers at their schools, in Oxford and St. Louis. The university 
project staffs took care of distribution in San Francisco and Denver. In all 
cases, postage-paid, pre-addressed return envelopes were attached to the 
questionnaires for their direct return to QRI. 

QRI kept distribution lists^'^aLFid conducted a mail follow-up on non- 
responding volunteers and teachers approximately 3 weeks after the forms 
were first sent out. A third follow-up was conducted by telephone by the 
university project staffs. 
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Final parent questionnaires also were mailed out to the home addresses 
early in May. Initiol returns were negligible. No follow-up on nonresponding 
Parents was conducted. It was decided that such an eifort would not be cost- 
effective. The most important information (family background characteristics) 
from parents had been sought in the Parent Registration Form, and returns on 
that were woefully inadequate, as described in Volume I. 

The questionnaire handling procedures used for the final forms were 
/ much improved over those used previous ly. Good response rates were obtained ' 
Only after considerable effort, but in a. much shorter period of time. 

Organization of volume ii 

The next section presents pre- and post-tutoring test results, along 
with volunteers' and teachers' assessments of changes in the children. 
Relationships between project evaluation criteria and various possible ex- 
planatory variables. are explored.* Section III contains descriptive analysis 
of volunteer and teacher impressions of the project stated on the final 
questionnaires. Case studies presented in Section IV describe the inter- 
actions of the tutoring situation, while Section V reviews project costs in 
relation to project benefits as measured by change in WRAT score. 
'Section VI deals with volunteer attrition. ^Conclusions about project out- 
comes and the Phase I evaluation process are drawn in the final section, 
considering implications for Phase II. 
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II. ANALYSIS OF TUTORING RESULTS 



PURPOSE AND CONTENT 

This section describes how the 'Upswing children changed over the _ 
tutoring period in the study's criterion areas: reading achievement, psycho- 
motor behavior, and self-esteem. Changes pointed up by the objective tests 
used are presented first; then teachers' and volunteers' subjective assess- 
ments are presented. The section concludes with an examination of signifi- 
cant relationships between the criterion variables and of how they appeared 
to be influenced by selected- independent variables. 

SUMMARY OF RESULTS 

# Tutoring was clearly effective in helping children 
improve their reading skills. There was a statisti- 
cally significant difference between the mean read- 
ing test score of the tutored and untutored groups; 
however, the number of points difference between 
the means was not great. 

# The children with lower initial levels of reading 
proficiency tended to show the greatest improve- 
ment. 

9 Based on amount of change in children's test scores 
over. the tutoring period, training did not increase 
volunteer effectiveness. 



Tutoring had no apparent effect on the children's 
visual-motor integration skills according to the 
Beery-Buktenica test results. 

Poor visual-motor integration skills as measured 
by the Beery-Buktenica did not prevent childre 
from making progress in reading. 



Teachers and volunteers both saw in/iprovemej 
children's self-esteem as an important benefit of 
*\one -to-one tutoring. Teachers, for example, said 
that two-thirds of the children considered to have 
esteem problems increased their self-esteem. 

o Teachers and volunteers both noted reductions in 
^j^r,:^-:^- hyperkinetic and distractible behavior. 

V vBased on the multiple regression analysis, a whole 
complex of conditions is involved in changing chil- 
dren's school performance. There is no one "key" 
or small set of key variables . 

• Volunteers' attitudes about how well they were pre- 
pared to use the methods and materials of tutoring 
showed the strongest relationship to change in read- 
ing achievement of all the variables considered. 

• Associated with the "adequacy of preparation" variable, 
above, is a cluster of conditions, all related to volun- 
teer satisfaction, that appear to have been related to 
child progress in reading. 

• Improved self-esteem and psychomotor control appear 
to have been related to improved reading achievement 
as measured by the WRAT. 
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CHILD POPULATION IN THE FINAL ANALYSIS OF UPSWING TEST DATA 

Fewer children are represented in the final analysis of Project 
Upswing test data than were represented in the preliminary analysis. The 
number was reduced for the following reasons: 

• Children transferred out of schools. 

• Increase in volunteer attrition (a volunteer had to 
have tutored up until March 1, 19 72, in order for the 
child to be included in the analysis; if the volunteer 
dropped out before this date, the .child was excluded) . 

• Lack of final test data for child. 

The number of children involved varies from test to test. A child 
may have missed only one from the entire final battery. ORI felt it would be 
unfair to discount a child totally from the evaluation if he/she had missed 
only one test. We therefore conducted separate analyses, obtaining the 
maximum number of children for each test. 

A summary follows for each test in the battery indicating the total 
number of children used for that test (by status group) , the cities involved in 
the analysis, and what conditions may have reduced the number of children 
considered. 

The WRAT 

Following is a table of the size of the child population for the analysis 
of initial WRAT results in Volume I against the final WRAT population, by status 
group (control— C; children with untrained volunteers— U; and children with 
trained volunteers— T) . A child was omitted from the analysis if his/her birth- 
date was missing from the test record form (the WRAT iL' age-adjusted) or if 
no final WRAT score was given. 
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Pre -Test 
WRAT Population 


Post-Test 
WRAT Population 


C-178 
U-135 
T-160 


C-163 (92%)* 
U-113 (84%)* 
T-130 (81%)* 


* Percentage of initial test population repre- 
sented in final analysis. 



Less than a fifth of the childien with trained and untrained volunteers were 
excluded from the final analysis of the WRAT* Almost all (92%) of the control 
children were included. 

The numbers of children from each city who were included in the 



initial and final WRAT analysis were as follows, by status group: 



City 


Control 


With Untrained 
Volunteer 


With Trained 
Volunteer 




Pre 


Post 


Pre 


Post 


Pre 


Post 


Denver 


44 


38 (86%) 


35 


30 (86%) 


45 


3 8 (84%) 


Oxford 


50 


46 (92%) 


48 


46 (96%) 


31 


31 (100%) 


St. Louis 


50 


48 (96%) 


30 


25 (83%) 


45 


40 (89%) 


San Francisco 


34 


31 (91%) 


22 


12 (55%), 


39 


21 (54%) 


Numbers in parentheses are the percentages of the initial groups repre- 
sented in final analysis. 



All four cities had most of the original control (C) population left in 
the WRAT analysis because the only factor causing reduction of that popula- 
tion was child attrition, which was low. The only severe reductions in any 
groups occurred in San Francisco; only a little over 50% of the original WRAT 
populations of T and U children in that city remain in the final analysis. 
This was caused primarily by volunteer attrition and secondarily by children's 
absence during the final testing period. 
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Volunteer attrition had less impact in Oxford because of the opportunity for 
closer personal interaction and because untrained volunteer attritees were 
replaced . 

The Metropolitan Achievement Test Series 

The reading subtest administered in Denver is not comparable with, 
initial Primer reading subtest so that the data could not be used in the final 
analysis. Can Francisco was previously excluded from the analysis 
Therefore, only Oxford and St. Louis data are used in the final discussion 
of Metropolitan results. The number of children involved from each of 
those two cities was as follows: 



City 


Control 


With Untrained 
Volunteer 


With Trained 
Volunteer 




Pre 


Post 


Pre 


Ppst 


Pre 


Post 


Oxford 


50 


40 (80%) 


48 


41 (85%) 


31 , 


30 (97%) 


St. Louis 


50 


48 (96%) 


30 


26 (87%) 


45 


40 (89%) 



The percentages given above show no extreme losses from the original popula- 
tions in any group in either city. 

The VMI 

The analysis of the VMI pertains to Oxford, St. Louis, and San 
Francisco. The VMI was not administered in Denver at the beginning of tutor- 
ing because copies of the test could not be obtained in time for the scheduled 
testing; thus there was no point in including the test in the final battery in 
Denver. Following is a tabulation of the initial and final population sizes for 
the VMI for the three cities where it was given. 



See Volume 1, page 2-25, for explanation . 



City 


Control 


With Untrained 
Volunteer 


With Trained 
Volunteer 




Pre 


Post 


Pre 


Post 


Pre 


Post 


Oxford 


50 


41 (82%) 


48 


42 (88%) 


31 


29 (94%) 


St. Louis 


50 


48 (96%) 


30 


2 6 (87%) 


45 


40 (89%) 


San Francisco 


34 


34 (100%) 


22 


9 (41%) 


39 


26 (67%) 



Again the impact of volunteer attrition in San Francisco is evident. Only 41% 
of the children who had an untrained volunteer and 67% of the children with a 
trained volunteer were included. All of that city's control children considered 
in the initial VMI analysis were included- The other two. cities are relatively 
equal in numbers of children who could be included in the evaluation. 

SCORE CONVERSION PROCEDURES FOR UPSWING'S TEST BATTERY 

The raw test scores were converted by computer to reduce the chance 
of error in hand conversion. The types of scores used in the final analysis are 
described below for each test. 

WRAT 

■ The WRAT standard score is the most precise and meaningful for 
comparative analysis and' probably is the most readily understood. The WRAT 
standard score has a mean of lOO and a standard deviation of 15; thus it Is 
statistically comparable to traditional IQ tests such as the WISC, although 
it is not directly comparable to the Slossen used in Upswing. The WRAT 
standard score is interpreted much like an IQ score, as explained in the test 
analysis. 

^Metropolitan Achievement Test Series 

The Metropolitan Primer reading subtest was given to the Upswing 
children at the beginning of tutoring and the Primary I reading subtest at the 
end. The raw scores were converted to standard scores for statistical analysis, 
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since the latter are directly comparable from battery to battery and from form 
to form. However, the Metropolitan standard score cannot be interpreted like 
the WRAT standard score. To avoid confusion, ORI carried the conversion one 
step further for presentation purposes, describing the Metropolitan results in 
terms of percentiles. The Metropolitan is based on grade-leve-1 norms (it is 
not age-adjusted) . The use of percentiles permits us to discuss readily where 
the Upswing children stood in relation to other first-grade children in the nation, 
regardless of age . 

VMI 

The VMI raw score converts to a chronological age equivalent, taking . 
the child's sex into account because of differential rates of maturity in males 
and females. Preliminary analysis showed that all groups of children tested 
as itnmature in visual-motor integration skills both before and after tutoring, 
even applying the less rigorous conversion scale for boys. Thus in the pre- 
sentation of evaluation results sex differences are not described. Where 
there was a difference between age equivalents for males and females, ORI 
averaged the two or used the age equivalent for males. 

ANALYSIS OF INDIVIDUAL TEST RESULTS 

The WRAT 

In Volume I, Section II, all groups of children (C, U, T) in all cities 
were established as comparable in starting level of reading achievement as 
measured by the WRAT (Level I) reading subtest. The Student's T-test showed 
no significant difference (criterion level Q^=0.05) between groups of the popu- 
lation as a whole (all cities combined) , between groups in any city, or be- 
tween cities in their total Upswing child populations. 
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The WRAT documentation provides standard score classifications as 

follows: 

Standard Score Classification 

130 and up Very superior 

120-129 Superior 

110-119 High average 

90-109 Average 

80-89 Low average 

70-79 Inferior 

69 and below Defective 

The initie- test means for all Upswing groups fell into the low-average 
range, ^ with very small standard deviations. This indicates that the 
project began with a very homogeneous group of children whose problems 
in reading apparently were not severe. As discussed in Volume I, what 
children showed on the test may have been different from what they showed 
in the classroom. Based on the limited Metropolitan results available and 
on information from teachers and volunteers, ORI believes that in- many 
cases classroom performance pointed to lower skills than were indicated 
by the test scores. 

All groups of children (C, U, and T) showed gains in reading 
achievement as measured by the WRAT. Figure 2.1 gives the mean 
standard score from the first and final WRAT for all of the children by 
status group. The figure shows that, as stated earlier, the initial means for 
all three groups fell in the "low average" category (range 80-89). The 
groups were virtually identical in mean standard WRAT score at the 
beginning of tutoring. On the final WRAT, all groups means fell in the 
"average" category (range 90 to 109) . 
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*~ There is one exceptioiTto this: the initial mean score of San Francisco 

children with untrained volunteers was 79, at the top of the inferior range. 
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FIGURE 2.1. INITIAL AND FINAL MEAN STANDARD SCORES ON THE WIDE 
RANGE ACHIEVEMENT TEST, BY STATUS GROUP, ALL CITIES 
(Range of W RAT standard score = 44 - 160 points.) 



The mean gain in standard score of the T children was 7 points. The 
U children gained 8 points, while the control children gained 4 standard score 
points. 

As might be guessed, the 1-point difference in the amount of change 
made by children with trained tutors versus children with untrained tutors (all 
cities combined) was not statistically significant (criterion level « = 0 . 05) . 
The Student's T-test affirmed, however, that the tutored children made more 
improvement in reading as measured by the WRAT than did the control children. 
The difference between tutored and untutored children's mean standard score 
gain was found to be statistically significant at the 0.001, level. This means 
that the same results would have occurred in 999 samples out of 1,000. 
Clearly the difference in level of reading achievement of these two groups was 
not likely to be a matter of chance. 

The WRAT documentation indicates that a child can move from one 
achievement classification to the next by increasing his standard score 10 
- points. This amount of gain obviously would be quite important. The per- 
centage of children whose scores increased 10 or more points was calculated 
for each status group. The results were: C - 22%, U - 37%, and T - 27%. 
These data show the C and T groups closest together, with the U group stand- 
ing apart. ORI believes these differences are noteworthy. Well over a third 
of the children with untrained volunteers gained 10 or more points, versus 
about a fifth of the control children and over a quarter of those with trained 
volunteers . 

It should be stressed that lesser gains are not insignificant. A child 
must progress in reading merely to maintain his WRAT standard score because 
it is age-adjusted. The standard score of a child who made no progress in 
reading (i.e. , who maintained the same raw score over time) would decrease 
over time. Table 2.1 shows a quarter of the control group losing ground, 
versus 15% of the U group and 21% of the T group. About'half of each group 
is in the moderate improvement area (no change in standard score to 9 points 
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TABLE 2.1 

DISTRIBUTION OF AMOUNT OF CHANGE IN WRAT 
STANDARD SCORE FROM INITIAL TO FINAL TEST, 
BY STATUS GROUP, ALL CITIES 



Number of Points 
•Change in WRAT 


Children Making Given Amount of Change 


Standard Score 


Control 


Untrained 


Trained 


-11 to -1 


40 


17 


27 




2 5% 


15% 


21% 


*0 to +9 


87 


54 


68 




53% :■• 


48% 


52% 


+10 or more 


36 


42 


35 




2 2% 


3 7% 


27% 


Total 


163 


113 


13 0 




100% 


. 100% 


100% 
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gain). The percentages making major gains have already been discussed. 
What the data in Table 2.1 show is that the U group tended, to improve more 
than any other. However, the T-test showed that the difference between that 
group and the group tutored by trained volunteers was not significant at the 
0.05 level. 

Figure 2.2 gives the initial and'^final mean WRAT scores by status 
group for each Upswing city. It should be noted at the outset that although the 
figure suggests there were some important differences between cities end be- 
tween groups within cities, none of these apparent differences was found to be 
statistically significant. That does not mean that in fact they were not signi- 
ficant, it simply means that, statistically, the differences could well have 
occurred by chance. The sizes of the populations after the total groups were 
partitioned by city were small enough that the probability of chance differences 
is quite high. 

Figure 2.2 shows that all three groups of children from Denver were 
originally performing in the "average" reading achievement range, although 
just barely. The children in St. Louis scored on the borderline of this level on 
the initial test. In looking at Oxford, however, the children were performing 
barely in the "low average" category; all of the groups had a mean standard 
score of 83 on the initial WRAT. San Francisco's untrained group scored on the 
borderline of the ''inferior" category (70-79), the mean score being 79, whereas 
the C and T groups were in the middle of the "low average" category. 

The Denver director feels that teachers there may well have been overly 
influenced by socioeconomic characteristics in id( ntifying children for the pro- 
ject. She felt that there may have beon a tendency for teachers to perceive 
lower skills in inner-city children (predominately black and Mexican -American 
children) from low-income families. This kind of phenomenon has been noted in 
other research and might have occurred in other Upswing cities as well as Denver. 

It appears from the data that, whatever the reason, teachers tended to 
underestimate the reading skills of the children as indicated by the WRAT. 
Many commented on questionnaires and in interviews that they had to identify 
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children for the project too early in the year. Another factor that could be 
quite Important was delay in completing the initial test battery. As noted in 
Volume I (page 2-14) initial testing continued through January in some cities. 
The number of these cases was not documented, but the longer school and 
tutoring experience of such children could have inflated the "pretutoring" 
means • . 

The Metropolitan data also are of interest here. As discussed in 
Volume I (pages 2-28, 29) the children scored lower on the Metropolitan 
Primer reading subtest than on the initial WRAT reading subtest. The Metro- 
politan is, by design, curriculum based. It would appear that the criterfa 
used by teachers in selecting children for Un'^v/ing may have been more in 
tune with the Metropolitan than with the WRA' '.^sults . This supposition 
tends to be supported by the correlations between teacher assessment of 
change in reading achievement and change measured by the WRAT and Metro- 
politan (see "Analysis of Influences ..." later in this section, page 2-73 ff.). 

The means in Figure 2.2 indicate that the greatest gains were made 
by children in Oxford — all groups, regardless of C, U, or T status. The 
control children in Oxford increased their scores more than any other group 
in any city except the T and U groups in Oxford and the U group in San 
Francisco, These data suggest that factors other than tutoring were working 
strongly in the children* s;favor in Oxford. There is no public kindergarten in 
the State of Mississippi, and a large number of the Upswing children had no 
previous school experience • Nevertheless, they were apparently ready to 
make strides with instruction. In ORVs opinion both of the schools in Oxford 
are outstanding , and the county school is a. showcase. Quality of schools 
appears to have been more important there than Upswing tutoring, unless the 
control children tended to be provided other special services, such as reme- 
dial reading instruction, more than the tutored children, to compensate for 
lack of a tutor* However, there apparently was a difference between the 
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tutored and control children that tends to be obscured by the means. This 
difference is illustrated subsequently (Figure 2.4). 

Another dramatic change occurred among the control group children 
in San Francisco. Their mean increase in WRAT score of 13 points took them, 
as a group, from the "inferior" to the "average" range of reading achievement. 
The San Francisco project director believes that the greater improvement of the 
U children as a group can be attributed to volunteer experience and attrition. 
In accordance with the project design, untrained volunteers were given little 
or no assistance by the Upswing staff. The director believes that this resulted 
in heavy attrition of inexperienced volunteers in that group, leaving a core of 
veterans from the San Francisco Education Auxiliary , the city's well-estab- 
lished school volunteer group, who were abV to function on their own. In the 
director's view, it wa.s probably the expertise of these people, based on ex- 
perience, that made the difference in U children's performance. 

Again it is noted that achievement gains of San Francisco children 
who had untrained Upswing tutors were not found by statistical test to be 
significantly greater than the gains of the other San Francisco groups because 
of the few children involved c 

Despite the lack of statistically significant differences, further 
analysis strongly suggests that the gains were real. ORI made cumulative 
plots of the percentage distribution of the changes in score of C, U, and T 
children in each city and for the project as a whole. These plots were con- 
verted for clarity to linear graphs (Figures 2.3-2.7) on a probability scale. 
Each point on a line represents the percentage of children whose scores 
changed an amount at or below the level indicated by that point. The upward 
slope of the line is more gradual when the group's increases in score are - 
small; thus the bottom lines on these graphs represents the group that im- 
proved least. 

Figures 2.3-2.6 show that the tutored and untutored children were 
two distinct groups in terms of amount of change in WRAT score. From the 
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divergence of the curves for tutored and control children, there clearly was a 
tendency for the former to make greater gains in every city. Figure 2.6 shows 
the much greater score gains of the U children in San Francisco, while in 
Denver and St. Louis (Figures 2.3 and 2.5 respectively) the T children take 
the lead. The U group in Oxford shows slightly greater gains. 

■ Comparing Figures 2.3-2.6 with Figure 2.7, one sees that the pat- 
terns of change in each of the individual cities are very similar to the patterns 
for the project as a whole in that one or both tutored groups consistently diverge 
from the control group. This leads ORI to conclude that, despite the lack of 
statistical significance in the differences between groups within cities, tutor- 
ing in all locations did in fact make a difference. Since the pattern was 
repeated in all locations it is reasonable to conclude that it was not a chance 
occurrence . 

The Metropolitan 

' Figure 2.8 presents the initial and final mean standard scores on 

the Metropolitan for the children in Oxford and St. Louis. In Volume I of this 
report ORP pointed out that the format of the Metropolitan series is difficult 
for young children, particularly those w;ho have visual-motor problems. 
Children must indicate their answer choices by filling in small spaces on an 
answer sheet; the scores of the Upswing children on this test are not neces- 
sarily trustworthy. 

The children in Oxford decreased in reading proficiency as measured 
by the Metropolitan. There were no meaningful differences between C, U, and 
T groups. Their mean standard scores declined from 25 to 2 3 for the T children and 
to 24 for the C and U groups, which put them in the 2nd and 4th percentile ranks, 
respectively, at the end of tutoring, whereas all fell in the 8th percentile initially. 
Thus the Oxford children finished the school year with reading skillS lower than 
over 90% of tho first-grade children on whom the test was standardized. This 
finding is in strong conflict with the WRAT results and with both teacher and 

volunteer assessments . . " 
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St. Louis' population of children did show improvement. The T and 
U groups Increased their mean standard score 6 points and the C group 5 points. 
In terms of percentile rank, the tutored groups moved from the 12th to the 22nd. 
However, it is misleading to talk of change in terms of percentiles since 
at the extremes of the scale a few points in raw or standard score translate 
into major changes in percentile rank. The percentiles are provided merely as 
a reference. 

VMI 

Tutoring apparently had no impact on the children's development of 
visual-motor integration skills as measured by the VMI. There was no difference 
in the mean VMI scores of the control and experimental children at the start of 
tutoring, either for the project as a whole or within any city. As Figure 2.9 
indicates, the three groups (C , U, T) had the same mean initial raw score, 10. 
This converts to a chronological age equivalent of 5 years 6 months for girls 
and 5 years 7 months for boys. The actual mean ac/e for the total population at 
that time was 6 years 8 months, with all groups comparable in age distribution. 
Seventy percent of the children obtained VMI chronological age equivalents 
below the population's mean actual age. 

Also frorn Figure 2.9, the post-tutoring mean raw score for both the 
control children and those tutored by trained volunteers was 11, while for child- 
ren tutored by untrained volunteers it remained 10. The VMI age equivalent for 
a raw score of 11 is 6 years 0 months for boys and 5 years 11 months for girls. 
The Upswing child population's (total) mean age at the end of the school year 
was 7 years 2 months. Thus the final test showed all groups were still well 
below the norm for their actual ages. 

The "T" test affirmed that there were no significant differences in the 
C, U, and T groups' initial and final mean raw scores or in amount of change 
over the tutoring period. The distribution in score was of course not 
normal, but decidedly skewed to the left, indicating no apparent 
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FIGURE 2.9. INITIAL AND. FINAL MEAN RAW SCORES ONTHE 
BEERY-BUKTENICA VISUAL MOTOR INTEGRATION TEST, 
BY STATUS GROUP, ALL CITIES 



gains by any of the three groups. The standard deviations of the mean change 
values for all groups were; C-2.2,U-2.1,T-2.3, reflecting the static 
nature of the scores. The groups were quite homogenous; no noticeable growth 
was made by any of them .% 

These results indicate that children's visual-motor difficulties were 
not solved simply by their growing older. In fact, if the trend should continue, 
their visual-motor skills will grow less adequate for the tasks expected of them 
in school. The data suggest that if Upswing volunteers are to be,' effective in 
this area they must be trained differently than they were in the first year. 
Emphasis on sob-cific remediation techniques is needed. Lack of development 
in visudl-motor integration i's not necessarily inconsistent with progress in 
reading, particularly when the latter is measured by the WRAT, since the WRAT 
requires only vocal response to visual stimuli. However, visual-motor 
immaturity does impair development of writing skills. One form of visual- 
motor remediation might be to teach writing skills. Training in how to do 
that properly should be given to the volunteers. 

RELATIONSHIPS BETWEEN TESTS 

There was a significant negative correlation (r= -J. 336) between 
initial and final WRAT bcores. This coefficient means that the initial WRAT 
explains about 11% of the variation in final WRAT. Since the correlation was 
negative, there was a tendency for children with 4ower WRAT scores at the 
beginning of tutoring to make greater gains over the year. 

From Figure 2.2, which shows mean WRAT scores by city and status 
group of volunteer, Oxford children would seem to have contributed most to 
this occurreTiee. It seems likely that the comparatively low starting point of 
all Oxford groups (T, U, C) could be attributable to lack of school (kinder- 
garten) experience. As noted previously, Oxford does-not have public kinder- 
garten, whereas all the other cities do. It appears that simply with exposure 
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(since the control group also did well) the children tended to make significant 
strides, reaching average reading performance by the end of the school year. 

Initial WRAT scores correlated .524 with IQ . Final WRAT scores 
showed a lower correlation with IQ of .396. The correlation between IQ and 
change in WRAT score was low and negative (-.085) . These data indicate 
that basic reading skills develop with instruction in a way that bears little 
or no relation to IQ, at least for children whose IQs are neither very low nor 
very high. Another point is that the presence of specific learning difficulties 
would tend to intervene in whatever effects IQ might have on development of 
reading skills , 

Initial VMI scores correlated negatively with the initial WRAT scores 
(r = -.133). One possible reason for this- is thpt visual-motor integration prob- 
lems were not the prime cc uses of the reading difficulties of these Upswing 
children. This is an unexpected finding, since the groups showed functional 
immaturity on the VMI, which usually is related to low reading skills. Even 
more unexpected was a weak negative correlation between initial VMI and 
Metropolitan scores (r=^-*.094); we anticipated that the children with visual- 
motor integration problems would have the greatest difficulty marking the 
Metropolitan answer sheet.. It is likely that test proctors helped such 
children mark their answer sheets. 

As noted earlier, none of the groups of children (T, U , C) made gains 
in VMI score over the tutoring period. The correlation of initial VMI with final 
WRAT produced an r of -.093/ while the final VMI correlated --.116 with the 
WRAT. The relationships are increasingly negative. There was no apparent 
relationship between initial or final VMI and change in WRAT. These results 
are attributable to lack of change in VMI while gains were made in tested read- 
ing skills. Had the children tended to lose ground in VMI, the final correlation 
would have been more strongly negative. The correlation between the final 
Metropolitan and VMI scores was high and negative (r = -.354). From this 
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result, one would predict high Metropolitan reading achievement scores for 
children with poor visual-motor integration skills. However, we believe 
this outcome is attributable to test-proctor intervention. 

CHILDREN INCLUDED IN ANALYSIS OF VOLUNTEER AND TEACHER ASSESSMENTS 
OF CHANGE 

More children are involved in this part of the analysis of tutoring results 
than were involved in the foregoing test analysis or in the regression analysis- 
that concludes this section. All children whose volunteers and teachers returned 
final impressions questionnaires are considered. The volunteer assessments, 
involve 222 children, while the teacher assessments involve 251. ; 

As stated earlier in this sectionvthere were 2 47 children left in the pro- 
ject at the end of the year according to our criterion of tutoring through March 
31 , 19 72. There were a few cases of teacher and/or volunteer returning a' form 
although the volunteer had attrited before March 31. These were included, 
producing a small discrepancy between number of children remaining and number 
of children included in this analysis. There also were a few cases of teacher 
and/or volunteer not returning the form although the child was still in the tutored 
population. However, the children reported on here are close to 100% of those 
who received tutoring through March 31 , 1972. The response rates were such 
that the data presented can be considered fully representative of the opinions 
of the volunteers and teachers associated with the project at the end of the 
year. 

DATA SOURCES 

As indicated above, the information for this analysis came from volun- 
•teer and teacher responses to a final impressions questionnaire for each group. 
These forms were distributed in May 19 72. 

SPECIAL CONSIDERATIONS ABOUT THE DATA 

There are no observations of control group children to compare with 
the observations of tutored children. The questions were worded to focus the 
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respondent's thoughts on the contributions of tutoring, but it is, strictly 
speaking, not possible to isolate the portions of change observed in the 
child that were attributable to tutoring as opposed to other influences. 

The intent of this part of the analysis is simply to look at the growth 
of the children through the eyes of the teachers and volunteer tutors. Their 
assessments provide the only measure of the criterion variable change in self- 
esteem; no test of self-esteem was included in the test battery. It is clear 
from the limited data we have, that such a test is necessary for the evaluation. 
One has been developed for use in the second year of the project. 

When interpreting correlations between questionnaire and test data 
it should be remembered that the correlations were produced from the restricted 
data base of the multiple regression analysis. The number of children reported 
on by teachers in their questionnaires was 251 and the number reported on by 
volunteers was 222; the number of cases involved in the regression was 131, 
because both complete questionnaire data and complete WRAT data were re- 
quired for a child to be included in that part of the analysis. 

VOLUNTEER AND TEACHER ASSESSMENTS OF CHANGES IN THE CHILDREN 

Volunteers Describe Children's Overall Progres s 

The volunteers generally felt that the children they tutored made 
better overall progress in school than they would have without Upswing tutoring. 
Table 2.2 shows that more than a third felt that Upswing Brought about major 
improvements in the overall progress of the children they tutored, while over 
half saw limited improvement. The total percentage of children in whom im- 
provement was noted is 88%. . ^ 

Comparison of these data with the distribution of change in WRAT score 
(Table 2.1, page 2-11) shows that the volunteer assessments of change in over- 
all rate of. progress tended to be in line with change in reading as measured by 
the WRAT. The volunteers found more cases oi major gain and fewer cases of 
no change than did the test, but they undoubtedly were considering aspects 
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of development other than reading. This volunteer assessment correlated .210 
with change in WRAT scire, while the volunteer assessment of change in read- 
ing skills showed no meaningful relationship with change in WRAT score. 

The division of opinion about overall progress among volunteers in 
different cities was similar (Table 2.2) . Denver and Oxford volunteers more 
often felt tutoring resulted in major improvement and the San Francisco volun- 
teers saw major improvement less often. There was virtually no difference in 
the assessments given by trained and untrained volunteers, as shown in 
Figure 2.10. 

Teachers Describe Children's Progress Toward Average Grade-Level 
Achievement 

In response to a question similar to the volunteers' overall progress 
question, teachers found nearly 90% of the children moving toward their aver- 
age grade-level performance. Of these children, 3 9% were described as 
actually "catching up" and 50% as "making progress"; 9% were reported to be 
losing ground (Figure 2.11). 

Table 2.3 has the details. Here San Francisco has the highest per- 
centage (61%) of children observed to be at least "making progress" and the 
lowest (3%, or one child) observed to be losing ground. Aside from this, the 
table reflects the consistency that typifies progress evaluation by teachers 
in the four cities . 

Teacher assessments of progress toward grade-level achievement 
showed no correlation with change in WRAT score. However, this type of 
assessment did correlate highly with the teacher assessment^cjif change in 
reading and other language skills (r= .651 and .466 , respectively), which 
did correlate with change in WRAT. This suggests that reading and other 
language skills were mediating variables, i.e. , associated to a degree with 
both change in WRAT score and teacher assessment of progress toward grade- 
level achievement. However, both the WRAT and the subjective overall pro- 
gress assessment evidently involved other variables as well, not in common. 
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1. In your opinion, what overall impact has Project 
Upswing had on the progress of the child you tutor? 

(check one) 

a. I feel that Upswing has resulted in major 
improvements in the progress of my pupil . . [ ] 

b. I feel that Upswing has resulted in limited 
improvements in the progress of my pupil . . [ ] 

c. I friel that Upswing has hjd no effect on the 



progress of my pupil . [ ] 




Major Improvement Limited Improvement No Effect Don't Know 



FIGURE 2.10. TRAINED AND UNTRAINED VOLUNTEERS' ASSESSMENTS 
OF PROJECrS OVERALL IMPACT ON THEIR 
PUPILS' PROGRESS IN SCHOOL 
(Nonresponse to question: 2% trained, 1% untrained.) 
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6. How would you deicribe the child's 
overall progress (all subjects) toward 
average grade level achievement? 

a. Child seems to be losing 
ground 

b. Child seems to be making 
progress but not catching up 

c. Child seems to be catching 
up 



'T 



a. 



50 



40 



30 



20 



10. 



50% 



9% 



39% 



Losing 
Ground 



Making 
Progress 



Catching 
Up 



FIGURE 2.11. TEACHER ASSESSMENT OF CHILDREN'S PROGRESS 
TOWARD GRADE-LEVEL ACHIEVEMENT, ALL CITIES 
(Nonresponse to question: 2%*) 
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Volunteers Describe Development of Reading Skills 

The data on change in reading skills are composites of volunteers' 
assessment of specific skill components— ability to sound out new words, 
ability to understand what is read, and abifity to read with expression. 

The total column in Table 2 A shows that 40% of the volunteers believed 
their pupils made some improvement in reading proficiency during the tutoring 
period, while about 20% considered their pupils to have made major improve- 
ment. From the analysis of WRAT results, which suggested gains by about 80% 
of the tutored children, this is e conservative estimate. The, WRAT standard 
scores of only 18% of the tutored children declined over the tutoring period, 
showing they made no progress- or lost ground. About a quarter of all tutored 
children increased their WRAT scores enough to move up one category or more 
in performance level. (See WRAT analysis, page 2-10.) This discrepancy 
probably was caused partly by the fact that the WRAT measures sight vocabulary 
and decoding skill, while the composite volunteer assessment of changed read- 
ing proficiency included comprehension skills. 

Going back to the analysis of volunteer assessments of overall progress, 
volunteers apparently felt freer to note more generalized gains. There was a 
faily good correspondence between those assessments and WRAT results. It is 
also likely that the WRAT, because it is administered individually, would pick 
up some of the not-strictly-reading gains that the volunteers were considering 
in their generalized assessments. For exapnple, a child's increased self-confi- 
dence in personal interaction and ability to understand, oral instructions should 
influence his performance both in tutoring and on the WRAT.' 

Table 2.4 shows some city difference in volunteer assessment of change 
in reading skills. Oxford and San Francisco volunteers tended to be more 
conservative, noting improvement in the reading proficiency of; respectively, 
54% and" 61% of the children ("some improvement" and "major improvement" 
combined) versus 71% and 61% in Denver and St. Louis. These differences 
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probably relate to language barriers between volunteers and children (see 
Section III, Table 3.12) that affected not so much the children's progress as 
the volunteers' perceptions of progress. Trained and untrained volunteers' 
assessments of change in reading skills are compared in Figure 2.12. No 
meaningful differences appear. 

Teachers Describe Development of Reading Skills 

Like the volunteers, teachers tended to note less progress when 
asked about specific skills. Teachers believed that about 70% of Upswing's 
child enrollees showed improvement in reading skills that was attributable to 
tutoring (compared with 90% considered to be making progress toward grade- 
level achievement). As shown in Figure 2.13, the teachers described 29% of 
the children as making "major improvement" and another 41% as making "some 
improvement" in their reading skills. They detected no gains (attributable to 
Upswing) in 24% of the students and found the reading skills of 2% of the 
children lower than before. 

A more detailed picture of this information is available in Table 2.5. 
There it is shown that, in the main, teachers in all cities made quite similar 
assessments of improvements in reading skills, as a result of Upswing tutoring. 
Only St. Louis teachers described children as having lost ground at the end 
of the tutoring program. They saw a decline in the skills of six children, which 
accounts for the 2% in the "skill lower" category of Figure 2.13 depicting all 
children on whom teachers reported. Because of the way the questionnaire 
item was worded, these teachers evidently believed the tutorial program con- 
tributed to those six students' lower performance. 

Teacher assessments of change in reading skills correlated positively 
with change in W RAT score (r= .164). Since the correlation coefficient is low, 
teacher and test were by no means always in accord about which children im- 
proved and how much they improved. Still the two sets of data can be said 
to support each other. 
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3. What effect has Upswing tutoring had 
on the child's development in reading 
(e.g., ability to sound out new words, 
understanding what he reads, reading 
with expression, etc.)? 

a. Child's level of skill, overall, 
seems lower 

b. No change observed 

c. Some improvement 
observed 

d. Major improvement 
observed 



100 



e. Not applicable to child at 
this stage of his development 



50 



41% 
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FIGURE 2.13. TEACHER ASSESSMENT OF UPSWING'S EFFECT ON 
CHILDREN'S READING SKILLS, ALL CITIES 
(The question was considered not applicable to 3% 
of the children. Nonrespoa^e to question: 1%.) 
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Comparing volunteer and teacher assessments, the teachers tended 
to detect fewer gains in reading than the WRAT, but slightly more than the 
volunteers based on the composite. The teacher assessment was generalized 
(i.e. / teachers were not asked to judge subskills such as ability to sound out 
new words). ORI believes this may be the main reason for the difference between 
their observations and the volunteers'. This assumption is borne out by the 
fact that, although the volunteers' specific assessment of change in reading 
and language skills did not correlate with the corresponding teacher assess- 
ments, the volunteer assessment of overall progress did (. 307 with reading 
and .222 with language). Another possible factor is that many volunteers — 
in interviews with ORI/on questionnaires, and in comments to teachers and 
city project staff — showed hesitance about making specific claims for the 
effects of tutoring. Sometimes this hesitance appeared to result from not 
wanting to appear boastful; in other cases it seemed that volunteers may have 
expected more dramatic gains than are reasonable in most cases. 

Volunteers Describe Development of Language Skills 

Volunteers noted improved language skills somewhat more commonly 
than improved reading skills. Table 2.6 (total column) shows that 57?^ of thff 
volunteers noted some improvement in their pupils' language skills other than 
reading, anH 15% noted-major improvement, for a total of 72% progress. 
Table 2.6 presents mean percentage of progress noted based on assessments 
of three subskills that call for different criteria based on what can be expected 
of an Upswing-age child. The more advanced skills deflated the assessments 
of progress. It is clear, however, that volunteers believed more growth oc- 
curred in speaking vocabulary, ability to express ideas clearly, and ability 
to understand through listening than occurred in reading proficiency. Since 
one-to-one tutoring allows a unique opportunity for children to practice oral 
language skills, with no special expertise required of the tutor, it is quite 
likely that Gignlficant growth occurred in that area., and greater growth than 
occurred in reading. It is unfortunate that we do not have an objective 
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measure of oral language development, since it is at least as important as 
reading to a child's success in later life if not in school • 

Table 2,6 shows no significant differences in the assessments of 
volunteers from different cities. As noted earlier, Oxford and San Francisco 
volunteers tended to find that fewer children made progress in reading. ORI 
believes that this is related to the language barriers discussed in Section III, 
pages 3-43. We hypothesize that since language was a primary concern in 
cases where volunteers felt there was a barrier, they tended to focus on lan- 
guage development more than reading in tutoring and also tended to note more 
growth in language skills, which are commonly considered prerequisite to 
reading skills (although in fact they may not be) . 

Trained and untrained volunteers* assessments of language skill 
development over the lutoring period are compared in Figure 2.14, Again, 
as with reading, training status apparently had nothing tv> do wi^h pupil pro- 
gress, or with what the volunteers thought about pupil progress . 

Teachers Describe Developm^ent of Language Skills Other Than Reading 

According to the teachers. Project Upswing helped 60% of the children 
improve their language skills. Figure 2.15 shows that about 20% were obser- 
ved to make major improvement in speaking vocabulary and ability to express 
ideas clearly and 41%. to make "some improvement" in those areas as a result 
of Upswing*tutoring . No change attributable to tutoring was noted in 3 7% of 
the children. 

Comparing Figures 2.13 and 2.15, one finds that the teachers tended 
to obs.^rve improvement in reading skills more often than improvement in oral 
communication skills. The difference is not great, however, and the difficulty 
in human measurement involved should be considered here: it is hard to per- 
ceive a real shift in a child* s capability for oral expression over a year's time. 
Excepting those children who have undergone obviously great changes, this 
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What effect has Upswing tutoring had 
on the chitd's development in 
language skills other than reading 
(e.g., speaking vocabulary, ability to 
express ideas clearly, etc.)? 

a. Child's level of skill, overall, 
seems lower 

b. No change observed 

c. Some improvement 
observed 

d. Major improvement 
observed 
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41% 



37% 



1% 



19% 




Skills 
Lower 



No 
Change 



Some 
Improvement 



Major 
Improvement 



FIGURE 2.15. TEACHER ASSESSMENT OF UPSV/ING*S EFFECT 
ON LANGUAGE SKILLS OTHER THAN 
READING, ALL CITIES 
(Nonresponse to question: 2%J 
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kind of assessment would be a borderline judgment. It is easier to take a 
tangible measure of reading skills. 

Comparison of Tables 2.5 and 2.7 prompts another kind of specula- 
tion on this point. The percentage of Oxford children in whom no change in 
language skills was observed is almost twice the percentage in whom no 
change in reading skills was observed. Most of Oxford's Upsv/ing children 
were from rural areas. Experiencing different language patterns at school 
and home may have impeded their development of language skills. Another 
possibility is that development of language skills went unoticed or was dis- 
counted because children's vocabulary and syntax did not conform to standard 
English. In any case, ORI does not want to make too much of this point. The 
correlation between teacher assessments of reading and of language skills 
yielded a high r value (.573), indicating that reading and language skills, or 
the teachers assessments of them, tended to go up together. 

As Table 2.7 depicts, the city patterns of responses from teachers 
on change in language skills attributable to tutoring were quite similar, with 
the possibility of some real difference in Oxford, -where the lowest percentage 
(15%) in the "major improvement" category was recorded, and in Denver, where 
the lowest percentage (30%) in the "no chang^e" category was recorded. 

Interestingly, although the volunteers tended to see less improve- 
ment in reading (Table 2.4) than did teachers, they tended to see more improve- 
ment in oral language skills (Table 2.6) than did teachers. This is reasonable 
considering the greater opportunity for a child to develop and demonstrate 
oral skills in a one-to-one relationship. 

The volunteer assessments of change in reading and language skills 
showed little or no relationship to change in reading as measured by the WRAT 
(r=.090), while the teacher assessments did (r= .164). The former correla- 
tion was made between point change in WRAT score and a composite score 

based on values assigned the volunteers' assessments of both reading and 
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language subskills. The composite score was of course weakened in the same 
way as the composite percentages given in Tables 2,4 and 2.6 and Figures 2.12 
and 2.14. 

Volunteers Describe Change in Self-Esteem 

One of the hypotheses of Project Upswing is that a child's actual 
academic success is related to his own estimate of his succeds in school, 
along with a sense of control of his environment • These attributes v\^ere 
labeled self-esteem. A further hypothesis is that tutors can positively affect 
children's level of self-esteem. The Upswing data support both of these 
hypotheses . 

A little over three-quarters 6f all the volunteers (trained and untrained) 
felt the children made moderate gains or better in their level of self-esteem. 
In Table 2,8, the percentages of volunteers who noted "moderate gains" and 
"major gains" combine for a total of 77%; 17% of the children were believed 
never to have had self-esteem problems. Only 5% of the children were found 
to make no gains although they needed to improve their self-esteem. 

Surveying the cities separately the response patterns are reasonably 
similar. The most important points to be made are that roughly 80% or more 
of the children in all locations were considered by their volunteer tutors to 
have self-esteem problems when tutoring began and 70% to 80% in all locations 
were observed to make gains (moderate and major) over the tutoring period. 
Figure 2.16'serves to separate and compare the opinions of trained and un- 
trained volunteers about changes in their pupil's self-esteem. Here the 
untrained volunteers are seen to have noted gains more ^ften then the trained 
volunteers. However, the differences are too slight" to suggest any significant 
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Have you noticed any change in the child^s 
confidence and/or self esteem since tutoring began? 

(check one) 

a. Child seems to have made major gains in 
confidence/self esteem [ ] 

b. Child seems to have made moderate gains in 
confidence/self esteem [ ] 

c. Child seems to have remained at about his initial 
level of confidence/self esteem, but this never 
appeared to be a problem area for him [ 1 

d. Child seems to have remained at about his initial 
level, but needs greater confidence/self esteem [ ] 

e. Child seems to have lost some confidence/self : 
esteem --Li 
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Major Gains 



Moderate Gains 



No Change Needed 



No Gains; Child 
Lacks Confidence/ 
Self-Esteem 



FIGURE 2. 16. TRAINED AND UNTRAINEi;) VOLUNTEERS' ASSESSMENT 
OF CHANGE IN THEIR PUPILS' CONFIDENCE/SELF-ESTEEM 
(No volun.teers thought their pupil's self-esteem decreased. 
Nonre;sponse to question: 1% trained, 1% untrained) 
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Teachers Describe Change in Self-Esteem 

When the teachers were quel^^ about changes in the children's 
level of self-esteem, they indicated that about half of the children reported 
on made gains in this area. Figure 2 . 17 shows that of the 50% who showed 
improvement, .26% made moderate gains and 24%, major gains. A quarter of 
the child population did not appear to have self-esteem problems according 
to their teachers. The other quarter was described as having esteem problems 
and not showing any signs of change. In the detailed breakdown of responses 
(Table 2.9), there are no outstanding differences. 

Thus, teachers and volunteers gave similar assessments of the rate 
of low self-esteem among the children when tutoring began. This kind of problem 
seems to have been rampant, affecting about 75% of the tutored children in 
all locations. However, the teachers and volunteers did not give similar 
assessments about the rate of improvement; the volunteers indicated that 
20% to 30% more children made gains. Nor did teacher and volunteer necessarily 
agree about v/hether a specific child made gains. Correlating the two assess- 
ments yielded no meaningful relationship (r = .011). Apparently children who 
demonstrated growing confidence in the one-to-one tutoring situation did not 
necessarily carry it with them into. the classroom group. 

Another interesting finding is that the volunteer assessment of change 
in self-esteem correlated with change in WRAT score— i.e. , as children's 
self-esteem increased, their WRAT reading performance increased . jThe teacher 
assessment of change in self-esteem did not correlate with change in WRAT. 
It appears that manifestations of self-esteem that surface in tutoring do 
influence performance on the individually-administered WRAT . • 

V olunteers Describe Children's Readiness to Communicate 

Children's will.ngness to express themselves orally is commonly 
associated with level of self-esteem, and the Upswing volunteers' assessments 
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What change, if any, in the child's 
confidence and/or self esteem have 
you noticed since tutoring began? 

a. Child seems to' have made 
major gains in coprf4dence/self 
esteem 

b. Child seems to have made 
moderate gains \ \^ 

, cxjnfide nee /self esteem 

c. Child seems to have 
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level, but this never appeared 
to be a problem area for him 

d. Child see ms to have 
remained at about his initial 
ievRi, but needs greater 
oonfidence/seif esteem 
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some confidence/self esteem 
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Same, 
No Problem 
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FIGURE 2.17. TEACHER ASSESSMENT OF CHANGE IN CHILDREN'S 

SELF-ESTEEM, ALL CITIES 
(No teachers thought their pupils' self-esteem decreased. 
Nonresponse to question: 2%.) 
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of change in esteem correlated ,386 with their assessments of change in 
willingness to speak out. 

Table 2.10 presents assessments of change in children's willingness 
to express themselves orally given by the volunteers in each city. The total 
column shows overall improvement , apart from those children whom the volunteers 
felt needed no change (31% of all children reported on). Twenty-seven percent 
of the children were found to have made major improvement and 36% moderate 
improvement. 'Again, as in their assessment of the children's self-esteem, 
volunteers saw only 5% as needing improvement but not showing any as yet. 

Oxford volunteers noted significantly more problems of this kind (17% 
of responses in the "no change needed" category, versus 43%, 32%, and 29% 
for Denver, St, Louis, and San Francisco, respectively). The higher "problem 
rate" in Oxford probably occurred because of the shyness of rural children 
with no school experience when tutoring began, Denver voluTrfeers found 
significantly fewer children with problems of this kind. Volunteers in Oxford 
and San Francisco noted about 10% of the children who still had difficulty 
talking freely at the end of tutoring, another finding probably related to 
language barriers. Figure 2.18 shows barely any difference project-wide, 
betv/een trained and untrained volunteers' assessments. 

These data show, most importantly .» that according to their volunteer 
tutors, roughly two-thirds of the Upswing children were hesitant to talk at 
the beginning of tutoring. Tutoring apparently made an important contribution 
to resolving th^s significant problem, since almost 100% of the children who 
were reticent or withdrawn initially v^ere observed by their volunteer tutors 
to make gains. 
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7. Have you noticed any change in the child's 
willingness to express himself oraWy? (check oncj 

a. Yes, there has been a major improvement . , ( 1 

b. YesVthere has been moderate improvement . I ] 

c. No, he has expressed himself freely throughout 
tutoring I 1 

d. No, I have not noticed any change, but I fee! 
there is a need for grov/th in this area [ 1 

e. Yes, the child seems to have withdrawn .... 1 1 



60 



[ I Trained 
V/l Untrained 



50 



40% 



40 



30 



20 



10 



30% 




32% 



30% 




Majof linprovement 



Moderate improvement 



No Change Needed 



Improvement Needed, 
None Observed 



FIGURE 2.18. TRAINED AND UNTRAINED VOLUNTEERS' ASSESSMENT OF 
CHANGE IN PUPILS' WILLINGNESS TO EXPRESS THEMSELVES ORALLY 
(No volunteers thought their pupils showed signs of withdrawal. 
Nonresponse to question: 1% trained •) 



Teachers Describe Children's Readiness to Communicate 

Teachers also were asked to assess the children's willingness to 
express themselves orally. The teacher assessments, like the volunteers', 
point to a high problem rate. Table 2.11 shows that, project-wide, about 75% 
of the children were thought by their teachers initially to need improvement 
in willingness to express themselves. This compares to about two-thirds who 
were believed by their volunteers:>to need improvement. The difference is 
not great, but is likely another reflection of greater reticence in a group set- 
ting than in one-to-one interaction. 

Although teachers noted a higher problem rate, they noted a lower 
improvement rate. Figure 2.19 illustrates that 27% of the children were con- 
sidered already fluent, 52% showed some or major improvement, and 18% 
believed to have a problem in this area showed no change. Those who 
improved in willingness to express themselves are -72% of the children who 
were believed to havu a problem. This compares to almost 100% improvement 
according to the volunteers. 

As was true with self-esteem, there was no relationship between 
teacher and volunteer assessments of children's willingness to express them- 
selves orally, indicating that often the two adults did not see a child in the 
same way. Again, it is quite likely the child did not act the same way in 
tutoiing as in class. Nevertheless, because of the percentages of improve- 
ment, it is clear that this was an area in which important gains occurred. 

Teacher assessments of change in children's willingness to express 
themselves orally were strongly related to teacher assessments of change in 
children's self-esteem (r = .511). This is an even stronger* relationship than 
was found between the /^^orresponding volunteer assessments. The oral 
expression assessment, Like teacher judgment of change i". esteem, showed 
ho relationship to change in WRAT score. Both, however, showed positive 
relationships to the skill -area assessments given by teachers. Thus, 
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40 



33% 



5. Hayo you noticed any change in the 
child's willingness to express himself 
orally since tutoring began? 

a. Yes, there has been a major 
improvement 

b. Yes, there has been a 
moderate improvement 

c. No, he has expressed 
Jiimself freely since the 

oeginning of the school year 

d. No, I have riot noticed any 
change, but ( fee) there is a 
need for growth in this area 



100 



e. Yes, he seems to have 
withdrawn 



30 



27% 



20 



19% 



18% 



c 

O 



10 



Yes, 
Major 
Improvement 



Yes, 
Moderate 
Improvement 



Already 
i-luent 



No, 
No Change 



FIGURE 2. 19. TEACHER ASSESSMENT OF CHANGE IN CHILDREN'S 
WILLINGNESS TO EXPRESS THEMSELVES 
ORALLY, ALI, CITIES 
(1% of children were categorized as withdrawn, 
Nonresponse to question: 2%.) 
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the children who were able to express themselves more freely in the classroom 
were ^hose regarded by teachers as having gained confidence and having 
improved academically. The volunteer assessment of change in children's 
willingness to express themselves also did not correlate with change in 
WRAT, but it did correlate with the volunteer assessment: of children's self- 
esteem, which correlated positively with change in WRAT. These outcomes 
indicate that improved self-esteem was involved in both greater communicative- 
ness and better reading, although greater communicativeness apparently )^'^.d 
no influence in the test situation. 

Volunteers Describe Changes in Psychomotor Behavior 

The volunteers were asked to assess their pupils on two psychomotor 
characteristics — hyperactivity and distractibility (defined on the questionnaire 
as "inability to pay attention"). These were selected because problems of 
either kind are readily observable, and can be singularly damaging to a child's 
performance in school and to his adult and peer relationships in school. These 
conditions commonly occur together and, when severe, usually are related to 
low self-esteem. 

Table 2.12 indicates that volunteers found hyperactivity in close to 
40% of the children (from the 62% of responses in the "no change needed" total). 
From the total column in the table, the hyperactive behavior of about 20% of 
all children reported on decreased either considerably or moderately, according 
to volunteers. Twenty percent of all children represents 52% of the 87 children 
% who were believed to be hyperactive. Sixteen percent of the hyperactive child- 
ren were found to have grown "considerably less hyperactive" by the end of ■ 
tutoring. ' 

The city differences pointed up in Table 2,12 are not great, except \ 
that there apparently were more hyperactive children in the Denver and San \ 
Francisco groups that received tutoring and, correspondingly, gains tended to 
be noted in those cities somewhat mere often. Once again, training apparently 
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made no important difference in child progress or volunteer assessment of 
progress (Figure 2 . 20) . 

Attention problems appear to have been a great deal more common 
than hyperactivity in the children who received Upswing tutoring. Table 2. 13 
(total column) shows that only 2-1% of the children were believed never to have 
had problems of this kind. Almost half of the responding volunteers felt that 
their students were deficient in ability to pay attention and did not improve 
over the tutoring period, while 11% observed a decline. Twenty-three percent 
of the children with problems were found to make gains. This breaks down 
into 3% major gains (in the table, 2% of all children reported on) and 20%> 
moderate gains (in the table, 16% of all children). Ability to pay attention 
is of Course a more abstract characteristic than hyperactivity and encompasses 
a broader range of behavior that included hyperactivity. This would account 
for the greater incidence of attention problems. The minimal progress noted 
by volunteers may have something to do with when the questionnaire was 
completed. Children typically become restless at the end of a school year, 
and the volunteers may have shared such feelings. As the novelty wears off. 
tutoring activities must be more and more carefully planned and paced. 

Singling out the four cities, one finds few notable differences. 
Table 2.13 shows Oxford with the highest percentage of children with attention 
problem's (only 12% "never a proble^n:!" versus 25%-30% in that category in the 
other cities) as well as the highest percentage o: gains. 

Figure 2.21 shows essential similarity in trained and untrained 
volunteers' assessments. The percentage of modest gains noted by untrained 
volunteers is close to twice as great as that for trained, although the per- 
centage of problematic children noted by trained volunteers v/as very slightly 
higher. It is interesting that s imilar 'proportions are evident in the hyper- 
activity assess.ments (Figure 2.20), ORI believes, however, that these 
minor differences are insignificant. . 
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Volunteer assessments of change in ability to pay attention showed 
a negative correlation with change in WRAT score, i.e. , more distractible 
children tended to do somewhat better on the reading achievement test. This 
finding suggests that boredom was involved in inability to pay attention during 
tutoring. Change in hyperactive behavior as assessed by volunteers showed no 
correlation with change in WRAT score. 

Changes in these psychoniotor characteristics as demonstrated during 
tutoring apparently were related to each other. The two volunteer assessments 
yielded a correlation coefficient of .311. 

As. for the hypothesized relationships between attention, hyperactivity 
and self-esteem, only one was supported by the volunteer data. Change 
in ability to pay attention as assessed by volunteer correlated .220 with change 
in esteem as assessed by the volunteer. . 

Teachers Describe Changes in Psychomotor Behavior 

The teachers 'also were asked to assess the tutored children on hyper- 
activity and inability to pay attention, and they too noted hyperactivity in 
ibout 40% of the children on whom they reported (Figure 2.22). Fifteen persjCnt 
of the total number of children reported on were found to make some improve- 
ment and 4% to make major improvement in controlling hyperactivity over the 
tutoring period. Th^^c is, about half of the children believed to have this kind 
of problem made steps to overcome it, according to their teachers. The other 
half showed no improvement in their teachers' view. About 6% of the total 
child population under consideration were said to grow more hyperactive over 
Che tutoring period and 12% to make no change. It should be not .'d that at 
least some improvement, due to maturation, could be expected. As discussed 
in relation to Table 2.12, the volunteers gave a very similai picture of rate 
of improvement. 

Table 2.14 shows that about half of the Denver children and about 
60% of those in San Francisco were considered .hyperactive by their teachers , 
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62% 



12% 



6% 



8. Hbs the child shown any changes in 
amount of hyperactive b«havk>r since 
tutoring began? 

a. Hvperactivity has increased 

h. Improvement is needed but 
none has been made yei 

c. The child was never 
hyperactive 

d. The child is somewhat less 
hyperactive 

e. The child is considerably 
less hyperactive 



15% 



4% 



Increased Improvement Never 
Hyperactivity Needed Hyperactive 



T 



ss T Considerably 
Hyperactive Less Hyperactive 



GURE 2.22. TEACHERjASSESSMENT OF CHANGE IN CHILDREN'S 
HYPERACTIVE BEHAVipR SINCE TUTORING BEGAN, ALL CITIES 
(Nonresponse to question: 2%.) 
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at least at the start of the tutoring program. San Francisco teachers noted 
improvement by the end cf the year in a slightly higher percentage of children 
considered to have this kind of problem, describing 55% of those considered 
hyperactive as less so and 5% (one child) as "considerably less so" (32% and 
3%, respectively, of all children on whom they reported). Denver teachers 
described 31% of the hyperactive children (16% of the total Denver group) as 
less hyperactive at the end of the year and 15% (8% of the total) as considerably 
less so. Denver volunteers noted improvement considerably more often (Table 
2.12). \ 

Oxford and St. Louis teachers, like the volunteers in those cities, 
did not find hyperactivity as prevalent as did their counterparts in the other 
two cities. Both the Oxford and St. Louis respondents indicated that about 
three-quarters of their pupils were "never hyperactive." The Oxford teachers 
noted improvement in a greater percentage of children who were considered to 
have this problem than did St. Louis or Denver teachers. 

ORI knows of no data on the incidence of hyperactivity in a "normal" 
population of Upswing-age childrerj. The rpughly one-third incidence reflected 
in both teacher and volunteers assessments seems high for a random sample 
^ut reasonable for a group selected on the basis of learning difficulties. Since 
hyperactivity is commonly a physiochemical problem/ the improvement nojied 
in the Upswing children ii:: somewhat remarkable and not necessarily attributable 
even in part, to the tutoring. For the same reason, the ii'icreased hyperactivity 
noted in about 5% of the children should not necessarily be considered an 
effect of latoring. 

The teacher assessment of change in amount of hyperactive behavior, 
like the volunteer assessment, was not correlated with change in WRAT score 
(-.065). The other hypothes... , that in a school setting hyperactivity and 
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self-esteem tend to vary together, is supported by the teacher data. The cor- 
relation coefficient between the two teacher assessments was a relatively high 
.281. The two corresponding volunteer assessments yielded no meaningful 
correlation. The volunteer's opinion of a child's level of self-esteem had 
rothing to do with the volunteer's opinion of the child's level of hyperactivity. 
It also may be that in the tutoring situation hyperactivity was not detrimental 
to self-esteem, while in the classroom it was, 

ORI also compiled data on teacher-measured changes over the tutoring 
period in the childrens' ability to pay attention. Figure 2.23 describes, only 
16% of the children from all the cities as never having had problems in this 
area. Thus the teacher data, like that from the volunteers, suggests that 
distractibility was a major difficulty of Upswi^ig children. 

Of the 85% of problematic children, teachers saw improvement over 
the tutoring period in two-thirds (while the volunteers saw improvement in only 
about a quarter of the children whom they felt had difficulty payir^g attention). 
Figure 2.23 shows 43% of the total population in the ^'moderate gains" 
category and 13%. in the major gains category. These figures respectively 
represent 50% and 16% of the children who were considered to have attention 

problems, for a substantial improvement total of 66^. Vc>lunteers did not see 

' • ' ' f 

this kind or progress, as diijcussed previously. Thus, the teacher and 
volunteer assessments of change in ability to pay attention did not correlate. 
About a quarter of the children had difficulty '^paying attention" but did not 
improve according to their teachers* About 2%. were found to be more dis- 
tractible after tutoring^. 

Table 2.15 shows two interesting contrasts among the cities. Denver 
teachers apparently felt a significantly larger percentage of their pupils had 
problems in this area than did teachers in the other cities. San Francisco 
shows a significantly smaller percentage of children making major gains in 
overcoming poor attention. However, the same cautions apply in interpreting 
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9. Has there been any change in the 
child's ability to pay attention since 
tutoring be^n? 

a. The child has made major 
gains in ability to pay 
attention 

b. The child has made 
moderate gains in ability to 
pay atitntion 

c. Poor attention was never a 
problem for this child 

d. There is need for 
improvement but none has 
been made yet 

e. The child's ability to pay 
attention has decreased 
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figure' 2.23. TEACHER ASSESSMENT OF CHANGE IN CHILDREN'S 
ABILITY TO PAY ATTENTION SINCE TUTORING 
BEGAN, ALL CITIES 
(Nonresponse to question: 2%.) 
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these data as in interpreting the data on hyperactivity. Comparing Table 2.15 
with the breakdown of volunteer opinion in Table 2.11, differences of opinion 
between volunteers and teachers within cities are evident, as indicated by ths 
correlation coefficient. 

Teacher assessments of change in ability to pay attention also did 
not correlate with change in WRAT score but did correlate highly with teacher 
assessments of change in children's self-esteem, their willingness to express 
themselves orally, their reading and other language skills, and their overall 
progress toward grade-level achievement. The teacher views of hyperactivity 
"and ability to pay attention alpo correlated, although the coefficient was 
comparatively low (r = .186). 

To summarize, hyperactivity and, particularly, inability to pay 
attention were common characteristics of the Upswing children. The two 
often occurred together and it appears that they often were alleviated together. 
Inability to pay attention was the more stubborn as well as the more common 
problem, in the volunteers' view, while it was more often resolved than hyper- 
activity according to the teachers. These psychomotor characteristics did 
not show the expected relationship to change in reading skills as measured 
by the WRATy but they were strongly related to change in reading and other 
skills as judged by teachers. 

ANALYSIS OF INFLUENCES ON CHANGE IN CHILDREN'S SCHOOL PERFORMANCE 

One of the evaluation objectives was to determine which, if any, 
conditions in the tutoring situation appeared to be related to the impact of 
tutoring on the children's reading performance. Another objective was to 
examine relationships between selected family characteristics {income, ^ 
number of children in the home, parents' level of education, etc.) and changes 
in the school performance of the tutored children. 
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Questionnaires for volunteers., teachers, and parents were used to 
collect data for these two parts of the evaluation. .The latter effort had to be 
abandoned because parents, the source of family background data, generally 
did not return their questionnaires despite follow-up attempts. (See Volume 
I, pages 2-2 and 2-40). The analysis of the impact of conditions of tutoring 
is described here. 

Methodology 

ORI identified 25 psychosocial variables associated with Upswing 
tutoring that potentially might ""influence its results. These were such things 
as volunteer's level of education, previous relevant experience, and previous 
training in child development; teacher's years of experience teaching first- 
grade children and previous experience working with a volunteer or teacher 
aide; regularity of volunteer's attendance at tutoring sessions; cooperativeness 
with teacher demonstrated by volunteer (teacher's assessment); volunteer's 
perception of teacher attitude toward him/her; etc. 

^ The psychosocial variables were operationally defined as items on 

volunteer and teacher questionnaires, {Response choices were assigned 
numerical values so that each variable could be considered as a quantity in 
each child's Upswing experience. These data were stored in a computer file 
of information for each child. All first and final test scores (including IQ) 
and the volunteer and teacher assessments of changes in the children's self- 
esteem, communicativeness, and psychomotor behavior also were included. 
The file contained data on a total of 4 6 variables. 

We then used the technique of stepwise maltiple linear regression 
to assess the degree to which the 46 variables appeared to be associated with 
the study's major criterion variable: change in reading achievement, as 
measured by the-\\/'RAT. The computer program also yields ^ matrix of cor^^ela- 
tion coefficients that express the amount of associated variation between all 

pos^sible pairs of variables involved. 

'i 
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The study's criterion variables included change in children's reading 
achievement, self-esteem, and psychomotor control. However, as noted 
earlier, only one of these— change in reading achievement — was entered into 
the regression as a dependent variable. The measure of change in reading 
achievement used for this purpose was the difference between initial and 
final WRAT score because the data from the Metropolitan Achievement Test 
were not usable for all cities and appeared to be unreliable. There was no 
change in psychomotor behavior as measured by the VMI test. Volunteer 
and teacher assessments of criterion-area changes in the children were in- 
cluded in the regression as independent variables. Since they are subjective 
measures, it was felt that the separate regression runs necessary to treat 
them as dependent variables were not warranted. However, we did want to 
explore their relationships to change in reading achievement as measured 
by the WRAT and to each other. 

Parameters of the Population 

In selecting the children who would be considered in this part of 
the evaluation, the first criterion applied was whether both pre- and post- 
tutoring WRAT scores were available for a child. The second criterion was 
completeness of questionnaire data. Only those children whose volunteers 
and teachers returned their registration forms and their first and final question- 
naires could be included. The population dealt with here is therefore much 
smaller than the population of all children who were tuLored through March 
1972 and who took both the pre- and post-tutoring WRAT (the population for 
the presentation of test results) . It is also smaller than the populations covered 
in the teacher and volunteer questionnaires. The regression considered data 
on 131 children. 
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General rindings 

The regression showed that 35 of the variables considered explained 
about 35% of the change in WRAT reading score. Adding variables beyond these 
35 did not increase proportion of variance explained by the regression. The 
correlation between any one variable and change m WRAT score was low. Table 
2.16 lists the 35 variables brought into the regression- The multiple revalues 
indicate the cumulative percetitage of variance in WRAT score that v;as accounted 
for as each variable was added. Note that after the eleventh variable, the in- 
crease in r^ becomes minute- The subsequent variables had negligible explan- 
atory power'. 

The observations that went into the regression can be categorized 
in two ways: as characteristics of the child (internal) or as conditions of 
the tutoring situation (external). The first category includes IQ; starting level 
of visual-motor integration and reaching performance; and chang e in level of 
self-esteem, hyperactivity, distracUbility , oral language skills, and overall 
academic performance. The second category includes such things as child's 
response to tutor , teacher' s understanding of her part in the project, volunteer 
assessment of training received , etc. 

Table 2.16 shows that, according to the regression, things internal 
to the child were most related to change in WRAT score. There was, however, 
a cluster of external conditions that showed-relationship to change in WRAT 
and to various "internal" changes in the children as assessed by teachers 
and volunteers. The most important cf these external conditions was whether 
the volunteer felt adequately prepared to use the methods and materials of 
tutoring. 

The fact that child characteristics contributed more to change in 
WRAT than did conditions of tutoring tends to strengthen the conclusion that 
very little about the tutoring situation mattered except that the ahild had a 
tutor. However, the circular nature of the relationships suggested by the 
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TABLE 2M 6 

V 

VARIABLES RELATED TO CHANGE IN WRAT READING TEST SCORE 



Variable 


Multiple r^"^ 


Volunteer feeling about whether he/ 
she was adequately prepared to 
use methods and materials in 
tutoring 


^ 

\ 

.116 


Volunteer assessment of change 
in child's self-esteem 


\ 

\ ' , 

. 149 


Volunteer assessment of change 
in child's ability to pay . 
attention 


i 

.172 


Volunteer assessment of child's 
response to tutoring activities 


.i99 \ 


Volunteer assessment of tutor- 
ing' s effect on child's over- 
all progress in school 


.221 


Teacher assessment of child's 
progress toward grade-level 
achievement 


.233 


Teacher assessment of change 
in child's reading skills 


.247 


Teacher assessment of change 
in child's ability to pay 
attention 


.259 


Teacher assessment of change 
in child's language skills 
other than reading 


.272 


Initial VMI score 


.283; 


r^ value x 100 = cumulative percentage of variation exoiained. 
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TABLE 2.15 (Cont) 



Variable 


Multiple 'r 


Teacher understanding of higher 
' role in the project* 


.292 


Volunteer assessment of the 
child's feelings about leaving 
class for tutoring 


.300 


Teachers willingness work with 
Upswing voluntee: again 


.305 


Teacher assessment of child's 
willingness to express self 
orally 


.311 


Volunteer's previous training in 
child development 


.315 


Volunteer's level of education 


.323 


Volunteer assessment of teacher 
attitude toward volunteer's help 


.328 


Teacher's previous experience 
working with volunteer or other 
classroom aide 


.331 


Volunteer rolo satisfaction 


.334 


Volunteer assessment of the 
preparation for tutoring given 
by Project Upswing 


.338 


* Beyond this point the variables were found to be of neglible value 
in explaining change in reading skill as measured by the WRAT. 
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TABLE 2.16 (Cont) 



Variable 


Multiple r^ 


Volunteer opinion about adequacy 
of guidance given by teacher 


O O A 

.339 


Teacher assessment of change in 
child's self-esteem \ 


. 3 41 


Volunteer v/illingness to be in 
Upswing again 


.342 


Volunteer attendance at tutoring- 


.343 


Teacher feelings about amount of 
time Upswing required 


.344 


Volunteer assessment of child's 
response to him/her 


.344 


Teacher assessment of change in 
child's hyperactive behavior 


.345 


Volunteer assessment of change 
in child's hyperactive behavior 


.345 


voiunieer opinion aDoui aaequacy 
of Upsv\^ing training 


.345 


Teacher assessment of volunteer 
cooperativenes s 


.346 


Volunteer assessment of change in 
child's willingness to express 
himself o.ally 


.346 


Volunteer's previous relevant 
experience 


! 

.346 
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TABLE 2.16 (Cont) 



Variable 


Multiple r^ 


Volunteer opinion about adequacy of 




tutoring environment ' 


.347 ^ . 


Teacher's experience teaching 




first grade 


.347 


Child's IQ 


.347 
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analysis indicates that the conditions of tutoring are of some importance 
(conditions relate to changes in the child other than reading proficiency, 
which in turn relate to changes in reading, which in turn foster move favorable 
conditions, i.e., attitudes). 

The regression stopped with 65% variation not accounted for by the - 
variables measured. It is likely that many other variables would have to be 
brought in to account for all the variation in achievement scores. All cannot 
be explored by any known research technique, but based on this year's findings 
ORI is particularly interested in getting a better measure of level of self-esteem 
during the second year of the project. Also, of course, data are needed on 
home environment to see how it enters into the. configuration of influences on 
tutoring results. Since our efforts to get this kind of information from parents 
was unseccessful, a test that reflects home environment is being used in the 
second year of Upswing. 

Analysis of Specific Variables Related to Change in Children's Tested Reading 
Achievement Level 

In the following explanation we are not considering multiple correla- 
tions, but rather the simple correlations between single independent variables 
and change in WRAT score. Analysis of the matrix of simple correlation 
coefficients produced by the regression program pointed up a few relatively 
important variables that were not brought into the regression or that appeared 
from the regression to have virtually no explanatory power. This kind of result 
occurs when one variable, independently related to the criterion variable 
(here, the WRAT), measures something also measured by a third variable 
that has an even stronger relationship to the criterion. 

The variables found to be most related to change in WRAT from analysis 
of both the regression results and the correlation matrix are given in Table 2.17 
The table shows the correlation coefficients for all pairs of variables. 
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Again in Table 2.17, we see that the strongest individual predictor 
of change in a child's WRAT score was how adequately prepared the volunteer 
felt to use methods and materials ^or tutoring. The correlation coefficient, 
• 226, indicates that this variable, by itself, explains about 5% of the variance 
of change in WRAT score • This variable also is related to the volunteer' s 
perceptions of the child's overall progress, hiis ability to pay attention, and 
his response to tutoring activities. The methods and materiali^ variable is, 
further, one of a cluster of volunteer satisfoction variables (variables 8 through 
10 in Table 2.17) that are all related to each other, to the volunteer's assess- 
ment of child's overall progress, and to change in the child's WRAT score. 
Although the individual correlation coefficients are low, the analysis suggests 
that these variables do influence change in reading achievement. It would 
be worthwhile to monitor these aspects of volunteer satisfaction as part of the 
process of managing a project like Upswing. 

Another condition of the tutoring sl'^.uation that showed some relation- 
ship to the criterion variable was whether the teacher understood her/his role 
in the project (variable 11 in the table; r = .101). Like the others this variable 
becomes more important by its association with other independent variables 
involved in the regression. It correlated positively with fulfillment of volunteer 
expectations about the project (variable 8 in Table 2.17), teacher perception 
of favorable responses by children to their tutors, and volunteer opinion about 
the adequacy of teacher guidance (which O.o not appear in the table because 
they did not correlate with change in WRAT score). The correlation between 
teacher role understanding and perception v")f language skill improvement by 
the child (variable 5 in the table) may be spurious. 

The other variables that seem to be related to change in WRAT per- 
formance were all characteristics of the children themselves. All measures 
of these variables were subjective — volunteer and teacher assessments— and 
in considering them, it should be kept in mind that the truth of the relationships 
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depends on the accuracy of volunteers' and teachers' perceptions of changes 
in the chiL; . 

As previously stated in the detailed analysis of volunteer and teacher 
assessments, it was hypothesized that increases in reading achievement would 
be associated with increase in self-esteem. The regression showed that this 
was true when the measure of change in self-esteem was volunteer assessment. 
In fact, volunteer assessment of change in children's self-esteem was the 
second best predictor of change in WRAT score according to the regression 
analysis (Table 2. IG). 

It is interesting that there was no relationship between volunteer and 
teacher assessments of change in children's self-esteern , and the teacher 
assessment of change in esteem did not correlate with change in WRAT score. 
Change in the children's skills as assessed by teachers did correlate with 
change in WRAT scores (variable 4 in Table 2.17, r = .164; and variable 5, 
r = . 138). However, the volunteer's general assessment of how tutoring affected 
their pupils (variable 1 in Table 2.17) showed a stronger correlation with 
change in WRAT score (r = .210). What these findings suggest is that volun- 
teers may have assessed the children more in the way of the test than did 
teachers. ORI believes that this probably was the case, since the volunteers 
worked with the children one-to-one and the WRAT is an individually-administered 
test. The data also suggest that teacher assessments may not necessarily 
give a true indication of a child's performance or performance capabilities. 

Changes in children's "ability to pay attention" as assessed by 
volunteers, was found by the regression to be the third best predictor of 
change in WRAT score. The correlation between the two was - .132 (Table 
2.17, variable 3). The fascinating thing about this relationship is that it is 
negative. There was a tendency for children who were considered more dis- 
tractible by their volunteers to make greater gains in WRAT score. 
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Twenty-three children were obserred by their volunteers to become 
more distractible over the tutoring period. Eighteen of these children improved 
their WRAT standard scores on the final test from 2 to 21 points. The four 
children found to be the most distractible and having the greatest problems 
giving attention made major aains in standard score (10, 17 , 17 and 18 points) 
The five children whose WRAT scores as well as ability to pay attention 
declined did not lose as many points as the increasingly distractible children 
gained. Their losses were 2, 2, 3, A, and 7, standard score points. Thus 
the negative correlation doe's not appear tp be a fluke. 



( 
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III. PARTICIPANTS' RETROSPECTIVE VIEWS 
OF PROJECT UPSWING 



PURPOSE 

This section is to give understanding of what Project Upswing was 
like in its first year. It provides better perspec.*:ive for judging project 
effectiveness and strengthens the basis for recommending changes for 
Upswing in the second year of the project.—'^ The topics covered include: 

o Project organization and operations 

® Volunteer training 

c Relationships among the various groups involved 

o Satisfaction of volunteers and teachers with the 
experience . 



— Many changes have already been made based on the information presented 
here. ORI informally reported most of these findings to the directors, 
sinca Phase II had to get under way before this report could be issued. 



1 

Volunteer and teacher assessments of changes in the children were presented 
in the Section II analysis of tutoring results. 

DATA SOURCES AND COLLECTION PROCESS 

The data presented in this section were taken from questionnaires 
filled out by Upswing volunteers and teachers at the end of the school year. 
(See Appendix for copies of these forms.) The questionnaires were mailed 
by ORI directly to Oxford and St. Louis volunteers and teachers in May 1972 . 
At the request of the university project directors in Denver and San Francisco, 
sets of the forms were provided to them for distribution by their staffs. A 
mail follow*-up on nonrespondents in all cities was conducted by ORI (forms 
sent out June 9, 1972). A telephone follow-up was conducted by the university 
project staffs approximately two weeks later. An attempt was made to contact 
all nonrespondents. 

FORMAT . ^ • 

Volunteers' and teachers' responses to questionnaire items are pre- 
sented separately. The data from volunteers are analyzed in two ways: by 
training status, and by city, generally without regard for training status, as 
appropriate. The data from teachers are analyzed for the project as a whole 
and by city. Comparisons are made between volunteer and teacher observations 
as appropriate. A summary of the important findings precedes the detailed 
questionnaire analysis in both cases. 
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volunteers" FINAL IMPRESSIONS OF PROJECT UPSWING 
Parameters of the Population 

A total of 407 volunteers registered to be Project Upswing tutors; 
223 were assigned to the trained group and 184 to the untrained group. 
Attrition made deep cuts in these numbers, reducing the training group 33% 
to 149 volunteers and the untrained 55% to 83 volunteers. A number of volun- 
teers who attrited returned final questionnaires, however, and they were 
included in this part of the analysis. (Those known to have attrited before 
March 31, 1972 were not sent forms, but ORI and the university project 
staffs did not know of all attritees, as explained in Section VI of this volume.) 
Others, some of whom stayed with the project to the end, did not return final 
questionnaires. Thus the number of questionnaire respondents does not 
exactly correspond to the number of volunteers who tutored the full time. 

The questionna^.*"e response rates were computed on the number of 
volunteers in each city and status group who were known to have received a 
questionnaire. The rates are given in Table 3.1. They are outstanding except 
for Oxford's untrained volunteers, 2/ although two follow-up waves were 
necessary to get them. Based on the number of volunteers left in the popula- 
tion after attrition, the respondents to the final questionnaire can be con- 
sidered fully representative of the volunteers who completed tutoring (except, 
perhaps , in Oxford) . 



There was a special problem in Oxford because of heavy student attrition 
and replacement of untrained attritees. Many of the students who tutored 
first semester were not sent forms since they were known to have attrited 
before March 31, 1972 . Replacement volunteers were sent forms when 
their addresses were known, but often did not respond, possibly because 
they felt unable to answer many of the questions, which were designed 
for respondents who has been involved from the beginning. 
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Summary of Volunteers' Final Impressions 



• Volunteers generally felt that 2-3 hours per 
week is the appropriate amount of tutoring 
time • 

• Eighty-five percent of the volunteers prepared 
for tutoring sessions beforehand. Most required 
only 15 minutes to a half hour preparation time 

• per session, indicating the task was not onerous. 

• The tuto!y.ng environment was unsatisfactory to 
many volunteers (close to half) , although most 
worked alone with the chile ren in unused rooms. 
Problems noted included such things as inade- 
quate lighting and equipment. 

*\ 

• j About 75% of all volunteers had no or few difficulties 
/ in getting materials needed for tutoring. The un- 
trained group encountered more problems in this 
area than the trained, since the project provided 

no or few materials for the former. 

• All volunteers evidently used a variety of materials 
and techniques in tutoring. The DISTAR and Peabody 
kits were not utilized to any great extent. 

• Nearly all volunteers considered their tutoring 
methods and materials effective. The trained 
Group tended to show somev/hat greater confidence 
than the untrained. 

o Teachers were a significant source of guidance 
and asslstance:for both trained and untrained 
volunteers, although, as expected, the untrained 
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more often considered teachers their primary 
source of aid . 

• About 40% of the traine,d and over half of the 
untrained volunteers felt they needed more 
guidance and assistance than they received 
during the year. 

• Volunteers indicated they wanted to work with 
teachers but did not favor highly directive 

teacher assistance. ; 

i 

• Both trained and untrained volunteers con- 
sidered day-to-day experiences with the child 

I 

as the most important contributor to effective 
tutoring. However only about 5% of both 
groups considered training unnecessary. 

• Trained volunteers were not fully satisfied 
with the training they received. Generally 
they wanted to learn how to. use a greater 
variety of instructional tectjniques, to know 
more about diagnosis of individual needs, and 
to know more about what is done in the class- 
room . ' I 

• It appears that relationships between volunteers 
and their pupils were almost always happy by 
the end of the tutoring period and that there 
were few major problems even at the beginning. 

• There was a sizable number of instances of 
language barriers between volunteers and 
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children, but such difficulties apparently 
did not interfere with rapport. 

• Teachers communicated positive feelings 
"to the volunteers . Most volunteers felt 

teachers welcomed the Upswing assistance. 

• Volunteers generally either were satisfied \ 
with the amount of support they received 
from teachers or wanted more. Almost 

none found teacher assistance overbearing — 
another indication of good relationships. 

• The majority of volunteers were, on the whole, 
satisfied with their experience in Project 
Upswing. There were areas of dissatisfaction, 
however. These included: preparation for 
tutoring given by Upswing (most notably, 
untrained volunteers wanted training) , 
communications, and assistance received 
over the year. Trained volunteers said 

they would be willing to tutor again slightly 
more frequently than untrained. 

• The comments from the volunteers* final 
impressions questionnaires indicated over 
all satisfaction with Project Upswing as a 
tutoring program. Many hoped that it would 
continue as part of a tutorial program in their 
cities and spread into a nationwide project. 
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Project Organization and Operations 

Tutoring Time , The volunteers generally believed that 2 to 3 hours 
per week were enough time to spend tutoring the children (actual time in con- 
tact with child excluding preparation time) . Looking at the total column in 
Table 3.2, 47% thought the 2 hours given in the first year adequate, while 33% 
said 3 hours per week would be better. Only: 4% thought 1 hour's tutoring would 
suffice, while 11% felt 4 hours or more a/e needed. 

Studying the opinions from each City, Denver volunteers stand out in 
preferring more tutoring time. Almost half stated that 3 hours per week should 
be spent in tutoring and about 20% said even more time is needed. 

The opinions of trained and untrained volunteers are presented for 
comparison in Figure 3.1. There was virtually no difference. 

Balancing the airipunt of time volunteers can give, transportation 
problems, other school experiences needed by the children, etc., it appears 
that 2 to 3 hours weekly is the appropriate ^^amount of time for in-school tutor- 
ing. Other data indicate general agreement that a single session with Upswing- 
age children should not run longer than an hour and for some children a session 
should be cut shorter than 1 hour. 

Preparation Time . Most Upswing volunteers spent 15 to 30 minutes 
preparing for each tutoring session. As Table 3.3 indicates (Total column) , 
61% gave this estimate. The next largest group, 17%, spent from half an hour 
to an hour preparing for the tutoring session. Only 4% put in more than an 
hour per session; 11% felt that special/ preparation was unnecessary and 5% 
said they had no time to prepare. Looking at the totals for the individual 

.cities given in the table, there are no noteworthy differences. 

I *\ 

Figure 3.2 shows the preparation time put in by trained versus un- 
trained volunteers. Their estimates were quite similar, although the percentcge 
of untrained volunteers who made no preparation for one reason or another is 
twice the percentage of trained in that category. 
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14. In your opinion, how much time should Upswing 
volunteers spend tutoring their pupWs? (your answer 
will help us in planning next year's 
program ) hours/week. 




1 Hour 2 Hours 3 Hours 4 Hours or More 



FIGURE 3.1. TRAINED AND UNTRAINED VOLUNTEERS' OPINIONS 
ABOUT HOW MUCH TIME PER WEEK SHO_lLLD_BILSPENT 

IN TUTORING, ALL CITIES 
(Nonresponse to question: 6% trained, 3% untrained.) 
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From these data it appears that preparing for Upswing tutoring was 
not a burdensome task and that most of the volunteers made an effort to plan 
their work with the children. ORI believes it is undesirable for tutors to "ad 
lib" and for that reason considers the 15% of the total population who did not 
prepare too large. However, the need for preparation was stressed in all 
cities, and it may not be possible to secure 100% preparation. 

The Tutoring Environment. The volunteers first identified the various 
areas in which they worked with the children. We found that 75% of all respond- 
ents used an empty room most often. The term empty room, somewhat nonspe- 
cific, refers in the main to classrooms not in use, storage rooms, nurse's 
office, etc. Table 3.4 (Total column) shows that 20% used a hallway and the 
remaining 5% tutored at the back of the classroom while the class was in 
session. 

Though not of great significance, it is interesting to note that volun- 
teers in Oxford, St. Louis, and San Francisco almost unanimously used empty 
rooms while in Denver there apparently was less available space and about 
half of the volunteers tutored in hallways. 

Table 3.5 gives the volunteers' assessments of the adequacy of their 

I 

tutoring environment. From the Total column, only a little more than half found 
it adequate— 56%; 42% described it as inadequate. To probe the reasons for 
satisfaction and dissatisfaction, we cross tabulated the ''adequacy" question 
responses with place of tutoring to find out if the opinion about adequacy was 
a function of place. Of the 44 volunteers who used hallways, half were satis^ 
fied and the other half were not. However, most of the 11 volunteers who used 
classrooms (with regular classes going on) were dissatisfied (eight or 73%). 
Of the 166 volunteers using empty. rooms, 63 (38%) thought this arrangement 
inadequate and 101 (61%) thought it adequate. Two did not give an opinion. 
Through reveiw of questionnaire comments, most volunteers who described the 
tutoring enviornment as inadequate, explained this view were bothered by 
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such things as lack of a blackboard, insufficient lighting, inappropriate 
furniture , etc . 

Table 3.5 shows a comparatively high level of satisfaction for San 
Francisco and a somewhat lower level for Denver. ORI has no explanation 
for these findings except that more Denver volunteers tutored in a hallway 
or in their pupils' classrooms. ^ 

Although the data are not fully conclusive, it appears that the volun- 
teers wanted to work alone with the child, away from distractions, but that 
proper equipment and lighting may have been considered more important than 
location per se. It should be noted that adequacy or Inadequacy of environ- 
ment was found by the regression analysis described in Section II to have no 
influence on how tutoring affected the children's performance. 

Availability of Tutoring Materials. According. to Table 3.6 (Total 
column), 58% of the volunteers could always get tutoring materials when they 
were needed and 21% usually could obtain the necessary materials . Com- 
bining these figures, availability of tutoring materials was not a significant 
problem project-wide . 

When the "always available" and "usually available" responses are 
combined, virtually no city differences are evident. In all cases, 75% to 85% 
of the volunteers had few or no problems locating materials. 

Figure 3,3 depicts how trained versus untrained volunteers described 
the availability of tutoring materials . Notably more trained volunteers were 
always able to find materials— 66% as compared to 49% of the untrained. 
About 20% of the untrained had difficulty getting materials (available spme- 
times, rarely, and never) , compared to 9% of the trained. 

These differences were to be expected since the project put materials 
in each school for use by trained volunteers. Fewer or no materials were sup- 
plied for the untrained; they had to bring their own or obtain materials through 
their pupils' teachers. 
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Tutoring Activities > The volunteers were asked to estimate how much 
time they and the children spent over the year on several kinds of tutoring 
activities: reading instruction using the DISTAR materials, language develop- 
ment using the Peabody kit, writing and telling stories, informal activities to 
stimulate conversation (taking walks around school yard, etc.) , practice on 
classwork in reading (using'^child^s reader, workbook, eta), practice on other 
skills or assignments as suggested by child's teacher, word or alphabet drill , 
games, reading library books, and motor activities. Table 3.7 gives these 
estimates separately for trained and untrained volunteers. The table indicates 
to what extent each activity was used, in terms of percentage of time spent 
on it diiring the year, and what proportion of volunteers used the activity. 

The table shows, most importantly, that all volunteers tended to vary 
tutoring activities; few spent a majority of time on any one or two types. It 
also shows that the DISTAR and Peabody kits purchased for trained volunteers 
were not well utilized, particularly considering their cost. Only 37% of the 
trained volunteers used DISTAR at all, and of these, almost half used it no 
more than 10% of the time while less than a third used it more than 30%. 
Peabody was used by 56% of the trained volunteers, but, as with DISTAR, 
they devoted little time to it (32% used Peabody only 1% to 10% of the time; 
only 4% used it more than 30% of the time) . A few untrained volunteers also 
worked with these m.aterials (7% used DISTAR and 16% Peabody) , but they, too, 
spent little time on them. 

Except for utilization of these two kits, which were not intended to be 
available to the untrained group, there were no striking differences between 
the tutoring activities engaged in by trained and untrained volunteers. The 
trained did more commonly work on motor skills; 56% spent time on motor 
activities, versus 31% of the untrained volunteers. Alphabet and word drill 
were used by slightly more untrained volunteers— 87% , compared with 76% of 
the trained. 



TABLE 3 . 7 

TRAINED AND UNTRAINED VOLUNTEERS' USAGE OF VARIOUS 
TUTORING ACTIVITIES/MATERIALS, ALL CITIES 



Estimate of Time 


Percent of Trained 


Percent of Untrained 


Spent 


Volunteers Using 


Volunteers Using 


(avg over year) 


Activity/Material 


Activity/Material 


DISTAR 


1% - 


10% 


17% 


5% ' 


11% - 


2 0% 


2% 


0% 


21% - 


30% 


8% 


0% 


31% - 


40% 


2% 


1% 


41% - 


50% 


4% 


1% 


51% - 


100% 


4% 


0% 






3 7% 


7% 


Peabody 


1% - 


10% 


32% 


' 12% 


11%- 


20% 


9% 


2% 


21% - 


3 0% 


11% 


1% 


31% - 


40% 


2% 


1% 


41% - 


50% 


2% 


0% 


51% - 


100% 


0% 


0% 






56% 


1 6% 


Writing/Telling Stories 


1% - 


1 0% 


48% 


43% 


.1.1% - 


20% 


15% 


11% 


21% - 


30% 


7% 


7% 


31% -' 


40% 


1% 


1% 


41% - 


50% 


' 1% 


2% 


51% - 


100% 


0% 


0% 






72% 


64% 


Informal Activities to Stimulate Conversation 


1% - 


10% 


51% 


38% 


11% - 


20% 


7% 


9% 


21% - 


30% 


1% 


2% 


31% - 


40% 


1% 


2% 


41% - 


50% 


0% 


2% 


51% - 


100% 


0% 


0% 






60% 


53% 
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TABLE 3 . 7 (Cont.) 



Estimate of Time 


Percent of Trained 


Percent of Untrained 


Spent 


Volunteers Using 


Volunteers Using 


(avg over year) 


Activity/Material 


Activity/Material 


Practice on Classwork in Reading 


1% 




10% 


38% 


18% 


11% 




20% 


13% 


13% 


21% 




30% 


12% 


20% 


31% 




40% 


9% 


11% 


41% 




50% 


3% 


11% 


51% 




100% 


2% 


6% 








77% 


79% 






Practice 


on Classwork in other Skill Areas 


1% 




10% 


38% 


3 5% 


11% 




20% 


8% 


14% 


21% 




30% 


3% 


11% 


31% 




40% 


4% 


2% 


41% 




50% 


2% 


2% 


51% 




100% 


0% 


0% 








55% 


64% '» 


Alphabet and Word Drill 


1% 




10% 


29% 


30% 


11% 




20% 


21% 


26% 


21% 




30% 


11% 


13% 


31% 




40% 


9% 


9% 


41% 




50% 


2% 


5% 


51% 




100% 


4% 


4% 








76% 


87% 
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TABLE 3.7 (Cont.) 



Estimate of Time 


Percent of Trained 


Percent of Untrained 


Spent 


Volunteers Using 


Volunteers Using 


(avg over year) 


Activity /Material 


Activity/Material 


Games 


1% 




10% 


47% 


43% 


11% 




20% 


1A% 


19% 


21% 




3 0% 


5% 


. 3% 


31% 




40% 


2% 


0% 


41% 




50% 


2% 


3% 


■ 51% 




100% 


0% 


1% 








70% 


69% 


Reading Library Books 


1% 




10% 


55% 


42% 


11% 




20% 


8% 


1 4% 


21% 




3 0% 


4% 


9% 


31% 




40% 


4% 


2% 


41% 




50% 


1% 


0% 


51% 




100% 


1% 


1% 








73% 


68% 


Motor Activities / 


1% 




10% 


49% 


2 7% / 


11% 




20% 


6% 


3% 


21% 




30% 


1% 


1% 


31% 




40% 


0% 


0% 


41% 




50% 


0% 


0% 


51% 




100% 


0% 


0% 








56% 


31% 



Effectiveness of Teaching Methods and Materials Used , The trained 
volunteers had a somewhat mere positive attitude about the effectiveness of 
the materials and methods they used with their students. From Figure 3.4/ 
32% of the trained as opposed to 18% of the untrained considered their 
approaches highly effective, while 65% and 71%, respectively, thought their 
methods and materials were"effective . " Six percent of the trained e nd 9% of 
the untrained volunteers found their approaches to tutoring ineffective. On an 
overall .appraisal , the questionnaire responses demonstrated general confi-- 
dence and belief in the benefits of tutoring to the children. 

Table 3.8 shows no major differences from city to city, although 
Oxford volunteers tended to show stronger confidence, more often considering 
their approaches highly effective, while San Francisco volunteers gave that 
.assessment considerably less often. Although the data are not tabulated here, 
it was the untrained volunteers in San Francisco who lelt less confident about 
their methods and materials (14% found them ineffective and none found them 
highly effective, while 0% and 21% of the city's trained volunteers gave those 
responses, respectively). Untrained volunteers also showed less confidence 
in Oxford and Denver, although not to such an extent as those in San Francisco. 

Volunteers' Principal Sources of Guidance . The untrained volunteers 
displayed a higher level of dependency on the teachers than the trained volun- 
teers. Figure 3.5 illustrates that 58% of the untrained, as opposed to 33% of 
the trained voL.nteers looked to teachers for their guidance. This was as 
expected, since the untrained volunteers were in a wav , a control group, and 
the trained, with their preii)aration, were to work with a comparatively greater 
independence of teacher^. Nevertheless, ..teachers were a major source of 
guidrnce for the trained group, giving them almost as much support as Upswing 
staff. In accordance with the project design, few untrained volunteers (14%) 
regarded the Upswing staff is their major source of guidance. 
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17. I feel that the teaching methods and materials I use 
as a volunteer have been: 

a. Highly effective [ ] 

b. Effective [ ] 

c. Ineffective [ ] 




Highly Effective Effective Ineffective 



FIGURE 3.4. TRAINED AND UNTRAINED VOLUNTEERS' OPINIONS ABOUT 
THE EFFECTIVENESS OF THE TEACHING METHODS AND 

MATERIALS THEY USED, ALL CITIES 
(Nonresponse to question: 3% trained, 2% untrained.) 
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The percentages relying on "other*' sources, apparently outside of 
Upswing, were surprisingly high. The questionnaire comments were insiiffi- 
cient to establish who.these others were. 

Table 3.9 shows that when training status is disregarded, teachers 
were by far the primary source of guidance for Upswing volunteers . This is 
reasonable since the teachers were most accessible. Reliance on Upswing 
staff as the primary source of guidance ran a stable 20% to 30% in ail cities, 
when training status is disregarded. Oxford volunteers tended to rely more 
on teachers and on each other than did the volunteers in other cities . The 
Oxford project director fostered closer relationships between the trained tutors 
and the teachers after learning that teachers were troubled by limited contact. 
Greater interaction among the volunteers themselves is attributable to the size 
of the community. 

Roughly 20% of Denver, St. Louis, and San Francisco volunteers were 
aided primarily by "others" outside the project. The data show that untrained 
volunteers in San Francisco reported no assistance from Upswing staff, while 
only 8% in St. Louis and 16% in Denver regarded Upswing staff as their pri- 
mary source of assistance » This was in line with the project design, as noted 
previously. One might anticipate that this lack of contact would contribute 
to attrition among untrained volunteers . That may have been true in San 
Francisco, where there were heavy losses of untrained volunteers; however, 
the data are inconclusive since St. Louis lost a lower percentage of untrained 
than any other city. 

Adequacy of Guidanca Received. The volunteers also were asked 
whether they received enough help during the year, regardless -of source . 
Trained volunteers tended to be more content than untrained, although neither 
group was fully satisfied. Figure 3,. 6 gives the breakdown. About 60% of the 
trained group said they received enough help, versus 43% of the untrained. 
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18. Who has been your primary source of guidance and 
assistance Huring the year? (check one) 

a. Teachei „,,..[ ] 

b. Upswing staff [ ] 

c. Other volunteer(s) [ ] 

d. Othex (please specify) . » / / 

I I Trained 
Untrained 



8% 



7% 



18% 



14% 




Teacher 



Upswing Staff 



Other Volunteers 



Other 



FIGURE 3e5. TRAINED AND UNTRAINED; VOLUNTEERS' PRIMARY SOURCES 
OF GUIDANCE AND ASSISTANCE DURING YEAR, ALL CITIES 
(Nonresponse to question: 8% trained, 3% untrained.) 
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19. Do you f^eel you have received enough guidance and 
assistance! during the year (for example, help in 
planning tutoring sessions, in getting materials, in 
specific problem-solving, etc.)? (check one) 

a. Yes [ ] 

b. No [ ] 
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54% 



43% 



37% 



Yes, Have Received Enough 
Guidance and Assistance 
During Year 



No, Have Not {Received Enough 
Guidance and Assistance During 
Year 



HGURE 3,6. TRAINED AND UNTRAINED VOLUNTEERS' ASSESSMENT OF 
ADEQUACY OF GUIDANCE AND ASSISTANCE-RECEIVED DURING 

YEAR, ALL CITIES 
(Nonresponse to question: 4% trained, 3% untrained.) 
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ORI believes that support to volunteers on a continuing and ready 
basis may be the most important factor in a successful tutoring project. 
Checking the comments made by both trained and untrained volunteers, we^, 
found feelings of personal inadequacy or insecurity common. Nearly 50% 
of the volunteers mentioned a need for more specific training, i.e., more 
training specific to problems they encountered with their individual pupils. 
This translates into more personal guidance or assistance and/or more inser- 
vice training that Includes opportunity for individual problem-solving. : 

Preferred Kinds of Guidance and Assistance . Volunteers were asked 
for their preferences about help both frorn Upswing staff and teachers. The 
question relating to Upswing staff was open-ended. By far the most commonly 
expressed preference was for help in diagnosing a specific child's needs and/ 
or planning tutoring activities to meet the child's needs. Oxford was an 
exception here, perhaps bedause the Upswing staff there was already giving 
diagnostic help and, as mentioned before, more volunteers there tended to 
have closer working relationships with the children's teachers. The Oxford 
volunteers suggested that the staff arrange a pretutoring meeting between 
teacher and volunteer, and a meeting (at some time) between parent(s) and 
volunteer; provicjie information about the child's family background; arrange 
idea-sharing meetingt^ of volunteers; provide more materials; and set up class- 
room observations for volunteers . 

In regard to help irom teachers, the volunteers were given the same 
list of types as was presented to the teachers in their questionnaire . Table 3 . 10 
indicates the order of preference in which they ranked the listed items. In 
general they showed greatest preference for nondirective forms of help and 
least preference for directive forms. Comparison of Table 3. 10 with Table 3. 18 
in the analysis of teacher impressions shows that what volunteers wanted from 
teachers turned out to be what teachers were most willing to give. Their 
priorities were the same. 
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Note that more than a third of the volunteers either did not answer 
the question about preferred forms of teacher aid correctly or skipped it, ^ 
The views of these people could change the ranking. It also should be noted 
that volunteers as well as teachers generally ranked the items in the order in 
which they appeared on the questionnaire. This brings up the possibility that 
even those who completed the ranking successfully may not have understood 
what they were to do or that they may have been influenced by the arrange- 
ment of items on the form. From interview remarks, however, ORI believes 
that volunteers in fact generally preferred guidance and not explicit direction 
from teachers; thus the ranking as presented in Table 3. 10 would be representative. 

Factors Considered Most Important to Effective Tutoring. Table 3.11 . 
shows how both the trained and untrained volunteer tutors ranked five additional 
variables aqcording to their importance to tutoring success. Both groups gave 
"day-to-day experience with child" first priority- Beyond this point of agreement 
the trained volunteers considered training in tutoring techniques and use of 
materials more important than other forms of experience, namely, previous 
experience with children in same age group and previous work as a tutor. They 
considered a close working relationship with the child's teacher least import;ant, 
probably because they had been schooled to independence in Project Upswing. 

The untrained tutors considered previous experience with children in 
the same age group as second most important and the volunteer-teacher relation- 
ship as third/ consistent with their greater actual dependency on teachers as 
previously described. Thus these data suggest that training does make a differ- 
ence in volunteers' attitudes about what counts in effective tutoring. However, 
the rates of nonresponse to this question, as to all the ranking questions on the 
form, were high, although about equal for trained and untrained volunteers (25% 
and 28% respectively). It is possible that the views of the nonrespondents 
would have caused shifts in the priorities just described. 
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volunteer Comments About Project Organization and Operations 

1 



- Tutoring Time - 

"More time might inconvenience the schools a bit too much." 

"This should be individualized according tc child, the need 
and teachers' desire." 

"I support the 2 hours weekly because it doesn't take the 
child out of the classroom too often." 



- Tutoring Environment - 

"Better teaching areas would have been a big help. Sitting 
in a closet or a noisy lunchroom didn't help much. But, it 
was better than nothing." 

"V/e were disturbed constantly and told to move if someone 
else needed space." 

"Too much interference. Had to seek out different quiet 
places." 

"Too numerous to enumerate (problems with tutoring environ- 
ment) . Name it and. it existed . " 



- Materials - 

"I did not know till program ended that materials were 
supplied.. " 

"I'll assume materials were always available; however, 
most of the time I used my own materials." 

"I did not find the materials provided very useful, but 
they seemed to be readily available." 

"All of these tutoring materials were good background 
but there v/asn't enough time to really learn enough to put 
them to the correct use." 

"Few materials were suggested which held this child's 
interest," 
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(Volunteer Comments About Project Organization and Operations, Cont) 

- Guidance - 

"I didn't receive much guidance from anyone.^' 

"I definitely feel that the child's teacher should give 
guidance. " 

"I would like to have more help in . . . planning tutoring 
sessions." 

"Assistance was always available, though I did not take 
advantage of it as I should have." 

"I think the assistance given this year was sufficient." 

"Guidance insufficient simply because I did not seek it." 

"I found it difficult to get someone at the Upswing office 
to talk with when- 1 had my one and only problem. " 

"Upswing is a good idea. The staff was ill-prepared. 
It was impossible to guide the volunteers, when they 
did not know what they were doing themselves." 

"I had not expected the teacher to demand so much time 
spent in one area." 

' "If a volunteer is to be effective and helpful I feel that a- 

teacher should not have to coach a volunteer too much. 
A teacher has other pupils to cope with, but cooperation 
is certainly desirable." 

- Factors Most Important to Effective Tutoring - 

"I think the most important factor is to let the child 
know you are interested in his progress." 

"Genuine interest and concern for child." 

"Facilities that limit distractions." 

"I feel it might be helpful if the tutor could meet the 
parents^and know more about the child* s background 
and home life." 
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Training 

General assessments of training (preservice) and orientation obtained 
from the "First Impressions Questionnaire" responses of both trained and 
untrained volunteers were presented in Volume I, Section V (page 5-12 ff •) . 
The final questionnaire followed up on this with more specific questions for 
trained volunteers only. 

The first of these questions was open-ended so as not to limit the 
volunteers' ideas. They were asked to state the topics they considered most 
important to cover in Upswing training. The following statements summarize 
tho most common suggestions: 

• Description of basic reading 'skills and how to teach 
them (including introduction to the reading program (s) 
used in the schools, which was considered very 
important by many volunteers; language experience 
approach; phonics; basic vocabulary for beginning 
readers; how to teach reading comprehension; more 
thorough training in how to use DISTAR and Peabody, 
if they are to be used .In the project) . 

• Appropriate books for Upswing children and first- 
graders in general 

• Review of appropriate games and other techniques 
and materials (a variety of alternatives) , where to 
get them, how to use them 

• Description of learning and other behavioral character- 
istics of first-grade' children in general and children 
who have learning difficulties in particular (i.e. , what 
to expect from the children, including what is expected 
of them in classroom performance) 



• Techniques of managing behavior (including, 
particularly, how to spark and hold interest, 
"get the child to listen'*; how to use behavior 
modification) 

i 

• Techniques helping a child develop self-confidence 

• Suggestions on how to establish communication 
with the child, including how to overcome language 
barriers and cultural differences 

• Review of diagnostic techniques and methods of 
ongoing evaluation of tutoring efforts 

• Suggestions of how to handle specific learning 
difficulties (preferably as they arise with individual 
children) • 

Dissatisfaction was not expressed by a majority of volunteers about 
any aspect of Upswing training . When dissatisfaction was expressed, most 
commonly it was with coverage of DI3TAR and Peabody. As noted in the 
analysis of techniques and materials used by volunteers, these were not 
favored as much as had been anticipated. Volunteers frequently did not care 
for the DISTAR approach or felt insufficiently versed in how to apply it; some 
found their pupils did not like it. The most frequently given reason for not 
using Peabody was that the Level I kit bought for Upswing was too elementary 
for the child as the year progressed. 

A high rate of nonresponse to the question probing attendance at 
inservice training limits analysis. The 16% nonresponse is difficult to interpret. 
It may be that they did not attend, could not remember which sessions were 
preservice and which were inservice, or did not understand the terms. From 
Figure 3.7, 60% attended more than half the training sessions with 20% attending 
less than half; 4% attended none of the sessions. We experienced a similar 
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35. How many inservice training sessions did you 
attend? sessions 
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30 



20 
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60% 



4% 



20% 



Did Not Attend any 
Inservice Training 
Sessions 



Attended Half or Less Attended Mo, e Than 

of the inservice Training Half of the Inservice 
Sessions Training Sessions 



FIGURE 3/7. TRAINED VOLUNTEERS' ATTENDANCE AT 
INSERVICE TRAINING SESSIONS 
(Nonresponse to question: 16%.) 
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problem with high nonresponse rates for the question abqut-^quality of inservice 
training (Figure 3.8) . Aside from the 15% not re§pot^ding, 43% thought the 
inservice training was good, 37% descril:^ it as fair, and 5% said it was poor. 



Neither the aji&ndance rates nor the assessments suggest great enthu- 
siasm foj^:theTlisen^^ sessions, which may have had something to do with the 
time of year (most sessions were offered in the late spring) . Questionnaire com- 
ments were insufficient to explain why beyond suggesting that there might have 
been a tendency for volunteers to take up too much time with anecdotes , and 
that some sessions (for example coverage of phonics) came too late to be as 
valuable as they might have been. 

Volunteer Commento About Training 

"I feel strongly that each volunteer should be given 
training. In my particular situation, given my particular 
student, the lack of training was not detrimental. How- 
ever, I think generally speaking, I would feel more secure, 
were I better armed with recognized tools and techniques 
to supplement my own intuition." 

"Expected better training." 

"I feel Melvin would have made more progress with a 
trained experienced tutor.!' 

"This program was very valuable to me but with more 
training or perhaps more experience in teaching I could 
have helped Betty more." 

"I feel that the greatest improvement which could be made 
in the training of volunteers would be to have it geared 
toward the 'one-to-one' approach. Even though our train- 
ing was good, it always pertained to a whole classrooms 
or to a group . " 

"The university training program was very helpful prior to 
start of tutoring in fall. " 
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36. How would you rate the inservice training? (check 
one) 

a. Good [ ) 

b. Fair [ ] 

c. Poor f 1 



43% 



37% 



5% 



Good 



Fdir 



Poor 



FIGURE 3.8. TRAINED VOLUNTEERS* RATING OF THE 
INSERVICE TRAINING. SESSIONS 
(Nonresponse to question: 15%.) 
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Relationships of Project Participants 

Volunteer-Pupil Relationship, On the final questionnaire the volunteers 
noted a definite shift in the children's responses to them over the tutoring 
period. Trained and untrained volunteers responses were coinbined for Fig- 
ure 3.9 since they were not significantly different. The figure shows that the 
percentage of children found to give "willing cooperation" doubled from the 
beginning to the end of tutoring (40% "then/'— 82% "now") . Follow: r..g the trend 
of increasing cooperation, only 12% of the students were described as showing 
"hesitant cooperation" by the end of tutoring as opposed tq 39% at the beginning. 
Five percent showed neutrality and only 1% (one child) appeared hostile. Thus 
the figure shows both improved relationships and close to 100% confidently 
happy relationships by the end of tutoring. It also shows that there were faw 
senous problems between volunteers and their pupils even at the beginning. 

Figure 3.9 makes an interesting comparison with Figure 5.8 in the 
Volume I description of volunteers first impressions of Upswing. In the latter 
illustration, the data were broken out by training status to establish the similarity 
of the two groups of volunteers. The data were taken from responses to a ques- 
tion about child* s initial response to tutor. Comparison shows that in the retro- 
spective assessment of beginning versus now, volunteers tended to give a lower 
assessment of initial response than they gave originally. This was to be 
expected since the final questionnaire item obviously was intended to determine 
whether the volunteer-child relationship changed over the year. Also, of course, 
as the two got to know each other the volunteer's assessment of the warmth of 
tha child's initial response might have changed. 
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Which best describes the child's usual response to 
you at the beginning of tutoring and no\N? (please 
check one for each time period) 

At the 

Beginning Now 

a. Willing cooperation '.. [ 

b. Hesitant cooperation [ 

c. Neutral [ 

d. Confused [ 

e. Hostile [ 



( } At the Beginning 
Now 




6% 



0% 



3% 



1% 



Willing 
Cooperation 



Hesitant 
Cooperation 



Neutral 



Confused 



Hostile 



FIGURE 3.9. VOLUNTEERS* DESCRIPTIONS OF CHILDREN'S RESPONSES TO 
THEM AT THE BEGINNING OF PROJECT, AND NOW 
(1% (two volunteers) did not make a judgment about initial response.) 
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The volunteers' view of how their pupils felt about missing class 
activities for the tutoring sessions also points to good child-volunteer rapport. 
From Figure 3. 10, 64% of all .volunteers who returned questionnaires thought their 
pupils considered tutoring a special treat. The 21% who found the children 
willing, although not enthusiastic, make a total of 85% who felt the children 
were at least interested in attending the sessions. Only 4% found their pupils 
reluctant to miss class activities, while 2% thought their pupils were embarassed 
to be singled out and 8% responded with "don*t know." 

A number of children were tutored during their recess time during the 
first year of Upswing. This was an unfortunate circumstance that would likely 
make a child reluctant to leave his class for tutoring. It is evident from 
Figure 3. 10 that being singled out would rarely embarrass a child so young, as 
it might an older child. Project-caused ego damage is apparently not a 
significant concern. 

Both trained and untrained volunteers generally felt the children responded 
well to tutoring activities. Figure 3.11 indicates that 74% of the trained volunteers 
found their pupils eager, 20% found their pupils neutral, and 6% thought theirs 
tended to reject tutoring activities. By comparison, the untrained volunteers 
felt that 66% of the children were eager to undertake activities, 29% were 
neutral, and 4% responded negatively. 

These data suggest that trained volunteers may have found tueir pupils 
slightly more responsive, but the difference is not clearlv established. Based 
on tutoring outcomes, ORI considers this possibility insignificant. The most 
important point about the data in Figure 3, 11 is that they give another indi- 
cation of strongly positive tutoring relationships and volunteers ability to 
excite children's interest in learning-related activities. 

Language barrier\S complicated about 18% of child-volunteer relation- 
ships project-wide (Table 3,12). Denver registered the fewest such communica- 
tions problems— 8%, probably between Spanish-speaking children and non- 
Spanish-speaking volunteers. In Oxford, 24% of the volunteers noted a language 
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4. How does the child seem to feel about missing class 
activities for the tutoring session? ( check one) 

a. Considers it a special treat [ ] 

b. Willing but not enthusiastic [ ] - 

c. Reluctant to miss class activities . [ ] 

d. Embarassed to be singled out [ ] 

e. I don't know [ ] 
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FIGURE 3.10. VOLUNTEER ASSESSMENT OF HOW CHILD FELT 
ABOUT MISSING CLASS ACTIVITIES FOR TUTORING SESSIONS 
(Nonresponse to question: 2%.) 
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2. What is the child's usual response to tutoring 
activities? fc/iec/c one) 

a. Negative [ 1 

b. Neutral [ 1 

c. Eager [ ] 
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FIGURE 3.11. TRAINED AND UNTRAINED VOLUNTEERS' ASSESSMENTS OF 
CHILDREN'S USUAL RESPONSE TO TUTORING ACTIVITIES 
(Nonresponse to question: 1% untrained.) 
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barrier. This percentage is probably a comment on communications problems 
between children from rural homes whose parents have relatively little formal 
education and upper-middle-class volunteers who are college graduates. 
Similar socioeconomic differences probably account for the 20% of language 
barriers reported by St. Louis volunteers, but in this case the children were 
from the inner city. Twenty-six percent of San Francisco volunteers were 
troubled by language barriers, probably related to Spanish-speaking and 
Chinese-speaking children. 

To trace further the effects of existing la. iguage barriers, ORI cross 
tabulated these results- with volunteer assessments of change in the children's 
willingness to express themselves orally. Of the 41 volunteers who described 
their pupils as having this obstacle in communication with them, 11 noted 
moderate gains in oral expressiveness; 10 children continued to have diffi- 
culty and 19 were described as never having had a problem. The measure- 
ment of the child's communicativeness is related more to the concept of shyness 
than to skill. It appears that for about half of these children, language differ- 
ences did not translate into reticence. The data do not show, of course, 
whether greater communicativeness on the part of a quarter of the children 
who had to deal with language differences was attributable tp increased 
command of standard English, to growing rapport with the tutor despite language 
differences, or to other factors. 

Language varriers do not appear to have interfered significantly with 
child-volunteer relationships . However, language differences may have 
influenced volunteer assessm'^nts of change in children's reading skills, in 
Oxford and San Francisco, as discussed in Section II. 
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Volunteer Comments About Their Relationships With Pupils 

"I was not really able to get to my child. He does 
not understand why I am helping him." 

"He felt through my encouragement as though he would 
be ahead of others in the class by practicing." 

"It was a challenge to overcome Harry's confusion and 
hostility and a feeling of success was developed as 
Harry seemed to enjoy our session together as time went 
on." 

"Other children in the class have asked me if they can 
have a tutor . " 

"He was bored in class. He liked anything better." 
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Volunteer-Teacher Relationship, Figure 3.12 shows that 81% of the 
volunteers felt th^^t their assistance was welcoiTied by the teachers, while 11% 
found the teachers neutral. Only 1% (two volunteers) felt teachers resented 
their assistance. Six percent of the volunteers said they did not know how 
the teachers felt about them. This can be attributed to limited contact, since 
lack of opportunity to talk was a problem commonly noted by both volunteers 
and teachers . 

These data point to volunteer-teacher rapport, which generally seems 
to have been the rule despite the possible differences of opinion, clashes in 
methods of instruction, and sense of competition that are often problems in 
in-school tutoring programs. ORI has been continually impressed by the good 
will of those involved in Project Upswing and their steady focus on the goal 
of helping the children. It is noteworthy in this context that more teachers 
evidently were dissatisfied than conveyed that feeling to volunteers. Figure 
3.23, presented later in this section, shows 22% of teachers not wanting to 
work with Upswing tutors again. \ 

Comparing Figure 3.12 to Figure 5,9 in Volume I, virtually no change 
occurred in volunteer perceptions of teachers' attitudes over the. tutoring . 
period. (Note that the populations of respondents are not identical; still the 
trends are comparable) . From the original distribution of responses (Figure 5.9), 
which were highly positive, the relationships could only have deteriorated. / 
That did not occur, at least in the opinion of volunteers who remained in the 
project through March 31, 1972, 

In Figure 3.13, about 80% of both trained and untrained volunteers 
received some guidance from their pupils' teachers. (As discussed previously, 
untrained volunteers worked more closely with teachers than trained.) 

Their preferences about teacher guidance are illustrated in Figure 3.14. 
About 60% of both groups were satisfied with the amount of guidance given by 
teachers and almost none in either group found it a hindrance ("I would have 
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2E. How does the child's teacher seem to feel about your 
assistance? (check one) 

a. I feel that the teacher has welcomed my 
assistance [ ) 

b. I feel that the teacher has been neutral about my 
assistance [ 1 

c. I feel that the teacher has resented my assistance 

[ 1 

d. I don't know how the teacher has felt about my 
assistance . [ 1 



6% 



1% 



Teacher has 
Welcomed my 
Assistance 



Teacher has 
Been Neutral 
About my 
Assistance 



Teacher has 
Resented my 
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Don't Know How 
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my Assistance 



FIGURE 3.32. VOLUNTEERS' ASSESSMENTS OF TEACHER 
FEELINGS ABOUT ASSISTANCE 
{Nonrespoiise to question: 1%.) 
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21. Did you receive any guidance from the child's 
teacher? 

a. Yes [ ] 

b. No [ ] 



□ 
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Untrained 
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Yes, Received Guidance 
From the Teacher 



No, Did Not Receive 
Guidance From the Teacher 



FIGURE 3.13. PROPORTIONS OF TRAINED AND UNTRAINED VOLUNTEERS WHO DID 
AND DID NOT RECEIVE GUIDANCE FROM THEIR PUPILS' TEACK2RS 
(Nonresponse to question: 1% trained, 1% untrained.) 
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d. I do not need any guidance from the teacher { ] 
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FIGURE 3.14. TRAINED AND UNTRAINED VOLUNTEERS* FEELINGS 
ABOUT THE ADEQUACY OF GUIDANCE RECEIVED 
FROM THE TEACHER 
(Nonresponse to question: 4% trained, 1% untrained,) 
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preferred less. , . . Forty percent of untrained volunteers wanted more help 
from teachers, versus 29% of trained volunteers. This difference was expected 
since the untrained group was to receive little or no support from Upswing 
staff while the trained group was not to rely on teachers. Apparently, from 
the minimal 6% of trained respondents who felt no need for teacher guidance, 
training did not eliminate the desire for support from the child's teacher. 

Comparison of the responses to this question with responses to an 
identical question on the "First Impressions" form shows no significant percentage 
changes . We interpret this to mean that the level of interaction between volunteers 
and teachers remained fairly constant over the tutoring period. 

Volunteer Comments About Their Relationships With Teachers 

"She has been very vocal about how pleased she is with 
the tutoring. Bless her heart." 

/ "She always made time to answer my questions . " 

"Teacher didn't care what I did as long as I took the 
child. 

"Teacher always gave me progress reports and pointed 
out problem areas." 

"She has told me how much Jimmy has ihiproved, making 
me more willing." 

"She (teacher) asked me for help." 

"The teacher and I had a very good relationship." 

"Mi3s (X] was very appreciative but she questioned 
me about why I was willing to volunteer so much time. " 
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Volunteer Satisfaction . 

One indicator of satisfaction is correspondence between expectations 
for an experience and reality. Roughly three-quarters of all volunteers who 
returned the questionnaire found Upswing to be as they had anticipated. Fig- 
ure 3.15 illustrates a 9% difference between the two groups in rate of fulfilled' 
expectation (81% trained versus 72% untrained) . 

Since the trained volunteers were exposed to considerably more infor- 
mation than the untrained, one might expect a greater difference between the 
two sets of responses. The 9% difference found is too slight to interpret 
considering the weight of opinion in both cases is heavily on the side of 
consistency between what was anticipated and what was encountered in the 
project. 

In a more specific question, volunteers were asked to indicate their 
degree of satisfaction with 10 aspects of Upswing. Working with the children, 
knowledge gained from the experience. Upswing's approach to working with 
children who have minimal learning difficulties, and working within the school 
system proved satisfying for roughly 80% to 95% of the volunteers, as shown 
in Table 3. 13. The areas of any significant dissatisfaction, for both trained 
and untrained volunteers were: the preparation for tutoring given by Upswing, 
assistance received, and project communications. Untrained volunteers more 
often said they were dissatisfied in all three areas (see Table 3.13) , as might 
be expected. More untrained volunteers were dissatisfied with their preparation 
for tutoring than were satisfied. This may well have been because they knew 
others received training. Lack of training did not impair their effectiveness 
with the children compared with the effectiveness of the trained group. It 
appears from the total analysis that the untrained volunteers did tend to feel 
left out and perhaps more insecure as tutors. 
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FIGURE 3.15. TRAINED AlvJD UNTRAINED VOLUNTEERS' REPORT 
ON WHETHER PROJECT UPSWING MET THEIR 
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(Nonresponse to question: 1% trained, 1% untrained •) 
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said they would not (Figure 3. 16) . These data show that the Upswing exper- 
ience was rewarding to most volunteers* Roughly 50% to 60% willingness to 
participate again seems high considering that mose of the volunteers were 
students or women with families who had many other demands on their time. 
It is noteworthy that here^ again, one sees the impact (although not great) 
of training on volunteer satisfaction, at least in a situation in which some 
receive training. More trained volunteers said they would like to continue as 
Upswing tutors— 63% of trained volunteers compared to 53% of the untrained 
volunteers . 

Of those volunteers who would participate again, a little more than 
half said they would like to be trained; a little less than half were noncommital, 
stating that it depends on the training; between 4% and 5% thought training 
unnecessary. Figure 3.17 compares responses of the two types of volunteer. 
The differences the diagram describes are slight, but it appears that trained 
respondents tended to feel that since they had been through Upswing training 
once, they would have to know something about content before signing up for 
it again. However, a significant percentage of the untrained respondents 
expressed similar reservations. Thus to some degree, this type response 
probably traces back to the value placed on experience by both groups. 
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30. Do you think you would like to continue as 
Upswing volunteer next year? (check one) 

a. Yes 

b. No 
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FIGURE 3.16. TRAINED AND UNTRAINED VOLUNTEERS* 
WILLINGNESS TO CONTINUE AS UPSWING TUTORS 
(Nonresponse to question: 5% trained, 5% untrained.^ 
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31. If you would like to continue as an Upswing 
volunteer, which statement applies to you: 

a. I would not want to receive training [ ) 

b. I would want to receive training [ ] 

c. I don't know/it depends on the training . . . . [ ] 




I Would not Want I Would Like to I Don't Know, 

Training Receive Training It Depends on the 

Training 



FIGURE 3 . 17 . FEELING ABOUT RECEIVING TRAINING EXPRESSED BY 
VOLUNTEERS WHO WOULD BE WILLING TO WORK AS 
UPSWING TUTORS AGAIN 
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Volunteer Comments Related to Satisfaction With Upswing 



"I think I failed Project Upswing for several reasons - 
niy child had more problems than learning ones and I 
did not cope well enough." 

"I have experienced a great deal which is hard to put 
in words. The reward from my child when he read a 
whole story by himself, was enough that made me 
wanting and eager to be on time and at every session." 

"Being able to help even one child who needs it is 
rewarding. " 

"I would just like to say that I really enjoyed being 
able to work with a child. As a future teacher I feel 
that I gained very valuable experience in teaching. 
It gave me a chance to know whether or not I really 
want to teach, " 

"In general/ I believe Project Upswing is a very good 
program. It helps children directly, aids the teachers, 
and is rewarding to the tutor himself. I hope the 
program will remain for a long time." 
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TEACHERS' FINAL IMPRESSIONS OF PROJECT UPSWING 

Parameters of the Population " 

There were originally 130 teachers involved in Project Upswing. By 
the end of the year 116 remained. Losses of teachers generally occurred not 
because they left the project but because they no longer had any pupils being 
tutored (either children changed schools or, primarily, volunteers attrited) . 
The final teacher questionnaire response rate for each city^ computed against 
the total number of teachers involved in the project at the end of the year, ' 
are given in Table 3 . 14. The rates given in Table 3. 14 show that the teacher 
responses can be considered representative of the total teacher population and 
of the individual teacher population in eaon city. 

Special Considerations About the Data 

Most teachers had more than one pupil involved in Upswing. Thus in 
the figures and tables describing observations of specific children, the totals 
are of children reported on by teachers, not numbers of responding teachers, 
and the percentages are based on numbers of children. In these cases N = 251 
for the project as a whole. Note that only 247 children received tutoring through 
March 31, 1972 (ORI's cutoff date for considering a child in the analysis of 
tutoring results). Four teachers reported on children whose volunteers left the 
project earlier, and these responses were not removed since they could not alter 
the patterns of opinions to any meaningful extent. 

Summary of Teachers' Final Impressions 

• The volunteers on whom teachers reported, primarily 
those who tutored at least through March 31, 1972, 
were faithful about keeping tutoring appointments. 
Apparently, most of the volunteers who tended to 
miss sessions droppod out earlier in the year. 
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TABLE 3.14 

RATE OF RESPONSE TO FINAL' TEACHER QUESTIONNAIRE, BY CITY 



City 


Teacher Population 

Rf Fnd of Tntorincr 


Final Questionnaire 
Ppcnnndpnts* 


Denver 


46 


46 






100% 


Oxford 


18 


17 






94% 


St. Louis 


21 


20 






95% 


San Francisco 


25 


22 






88% 


Total 


116 


105 






91% 



* Percentages given are percentages of the numbers of teachers 
in column 2 . . 
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• Teachers often were uncertain about how much guidance to 
give voluntev^rs. The types of guidance they said they 
would be most willing to give suggest that they prefer an 
advisory role rather than planning for volunteers and telling 
them what to do. However, most teachers felt they should 
be consulted, 

• Teachers found the majority of both trained and untrained 
volunteers well prepared for their work as tutors. However, 
the teachers generally thought the training given half of 
the Upswing volunteers worthwhile. Twenty-two percent 
more throught the trained volunteers were well prepared than 
had that opinion of the untrained. 

® From what teachers observed, the children and their volun- 
teers had very good relationships. Cases of hostility or 
confusion on the part pf a child were extremely rare. A - 
small percentage showed their teachers no feeling, either 
positive or negative. \ 

« Teachers found almost 100% of the Upswing volunteers 

with whom they had contac^t cooperative. About 20%, 

\ 

however, indicated they did not work with the volunteers 

\ 

enough to judge. \ 

\ 

• About three-quarters of the teachers indicated satisfaction 
with Upswing by their willingness to work with Upswing 
volunteers again. Many, howeyer, felt they did not fully 
understand the project and the teachers role in it. 

• A very large majority of teachers said that should they 
participate in Upswing again, they would prefer to 
work with trained volunteers* 
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Project Organization and Operations 

Volunteer Attendance « Table 3.15 describes tb^ regularly with which 
volunteers met with the children. It shows that of the total volunteer popula- 
tion reported on, 73% attended most of the sessions. .Some variability is evident 
among the cities. The data indicate that San Francisco volunteers and, to a 
lesser extent, those from Denver, tended to miss tutoring sessions more of^'^.n 
than volunteers in St. Louis and Oxford. The percentage who missed half or 
more of the sessions is higher in all cities than one might hope (range: 21% in 
Oxford to 39% in San Francisco) . 

The data in Table 3. 15 may be misleading because there was a tendency 
for teachers not to report on children whose volunteers dropped out early in the 
tutoring period. The percentages of volunteers who missed half or more of the 

tutoring sessions include some, but not all dropouts. 

/ 

Table 3.16 shoWs that, considerinp all cities combined, relatively 
few children had replacement tutors. Eighteen children (7% of the total number 
reported on) had their volunteers replaced once and two children (L% of total) 
had their volunteers replaced three or more times. Thus discontinuity of volun- 
teer-child relationships was not a significant problem. 

The table does not reflect how many volunteers dropped out and were 
not replaced. However, referring back to the introduction to this subsection 
(pa^e 3-62), we know that 46% (N = 247) of the original group of 407 children 
who were assigned tutors were no longer receiving tutoring by the end of March 
1972, in most cases because volunteers dropped out. It is. important to 
remember that high replacement rates reflect not only turnover, but also a 
successful' effort on the part of Upswing to continue the children's tutoring 
experience. Trained volunteers of course could ntit be replaced. 
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Volunteer Ouidan ce^. Responses to a question about hew much guid- 
ance teachers should give Upswing volunteer tutors show strong differences of 
opinion and a sizable element of confusion. There was an even, four-way 
split of opinion. (Figure 3 . 18) . About a quarter of the population said they 
did not know what guidance to give, about the same percentage as expressed 
any opinion. Thus it is difficult to draw any conclusion about what degree of 
involvement the 1971-7 2 participating teachers wanted. 

Table 3.17 gives the individual cities responses. In Denver, 35% of 
teachers felt they should have a hand in the activities of all \/olunteers, versus 
15% who said all volunteers should function independently. Thus, opinion there, 
although by no means a consensus (especially considering 20% either did not 
know or skipped the question) , wc.s more unanimous than in any other city. 
St. Louis shov's almost half in the "Don't Know" category; 45% cf the 
teachers there expressed uncertainty about how the/ should relate to the Upswing 
volunteers . 

In interpreting th^ implications of those data for the second year of 
Upswing, one might consider the teafchers who believed they should direct only 
untrained tutors with those who felt all tutors should work independently, since 
there are no untrained volunteers involved in the second year. This procedure 
Itips the balance of opinion toward the view that the Upswing volunteer tutors 
should be independent. However, a sizable group remains who felt that teacher? 
should direct tutoring activities. Role clarification is essential so that teachers 
and volunteers can know how to work together, !:yut the data suggest that the 
degree of teacher involvement will reflect personal preference. 

Kinds of Guidance Teachers Were Most Willing to Give Their Volunteers . 
Table 3,18 perhaps holds the key to interpreting what priorities teachers had in 
gi/ing direction to their trained and untrained volunteers. The table is based on 
responses to a question in. which teachers v^eve asked to rank six kinds of aid 
according to how willing they were to give each kind to Upswing volunteers . 
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17. How do you feel about giving direction to Upswing volunteers? 

(Check one) 

a. The teacher should direct most of the tutoring activities 
of Upswing volunteers who do not receive Upswing 
training [ ] 

b. The teacher should direct most of the tutoring activities 
of any Upswing volunteer, regarviless of training . . . . [ ] 

c. The Upswing volunteer, regardless of training, should 
fLnction independently of the teacher [ ] 

d. I do not know how much to give [ ] 
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FIGURE 3.18. TEACHdRS' PREFERENCES ABOUT GIVING DIRECTION 
TO UPSWING VOLUNTEERS, ALL CITIES 
(Nonresponse to question: 6%.) 
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The teachers ranked separat'rvly for trained and untrained volunteers. The table 
shows only majority opir^.on. For example, 77% of the teachers who answered 
the question said they were most willing to "discuss child's progress and 
problem areas" with his volunteer tutor; they ranked that choice number 1. The 
remaining 23%, not 3hown in the table, gave that choice another rank, from 
2 to 6; it was not the kind of aid they were most willing to give. The data on 
which Tdble 3. 18 is based show, however, that nearly every responding teacher- 
cons iaered the first three choices listed the top three, regardless of which 
was placed first, second, or third. 

Comparing Table '3. 18 to Table 3.19, one sees that the teachers prefer 
to give the kinds of assistance they in fact most often gave. Beyond that, 
which might be 3xpected, the most striking thing about Table 3. 18 is that it 
suggests training volunteers apparently does not influence teacher opinion 
about what kinds of assistance are appropriate. They seem to prefer 
not to directly govern the activities of tutors, regardloss of training. The top 
three choices are in the line of counseling, whereas the last three represent 
stronger direction and would be more tirre-consuming. Going to Table 3. 19, 
teachers more often gave the last three types of help to untrained volunteers, 
which may ha/e something to do with most teachers preferring to work with 
trained (that preference shown in Figure 3,23, presented later in this section) « 

The ranking directly coincides with the order of response categories 
as listed on the questionnaire. In order words, item 'a" on the questionnaire 
was ranked as their "most willing" choice, item "b" as their second, and \' 
"c" their third, etc. This brings up the possibility of response bias . That 
the majority of the teachers felt most willing to do "a" with the volunteers 
and lea^st willing to do "f" could mean that the format of the questionnaire 
tended to influence decisions. However, other da'La (Table 3.19 and Figure 
3.23, as discussed above, and questionnaire and interview comments about 
limited time to spend with the volunteers) suggest the ranking is true. 
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Teacher Comments About Project 



Organization and O p eration s 



—Volunteer Attendance— 

"In view of spotty tutor attendance , I'm reluctant to ascribe child's 
improvement to this program. " 

"Children gained when volunteer was regular in attendance." 

"The volunteer has been 'extremely' faithful about her attendance. 
She has always been quite punctual, also." 

"The people did not come regularly enough on the whole for the 
program to be effective. " 



—Appropriate Teacher Guidance of Volunteers — 

"There should be some contact between teacher and volunteer so the 
tutoring will be pertinent to what is going on in the classroom," 

"Any training will help the tutor and lessen the guidance I will have 
to give him . " 

"The volunteer and teacher should jointly decide and agree on the 
child's activities." 

"The teacher knows what needs to be accomplished and, due to 
experience, the most effective ways of accomplishing them." 

"I feel having a person use techniques different from my classroom, 
teaching on a one-to-one basis, is more beneficial." 



3-73 



Volunteer Training 

Teachers seemed to value the Upswing training program. Figure 3.19 

shows that 82% described the trained volunteers as well prepared to work as 

tutors, versus 60% who described the untrained volunteers as well prepared. 

These percentages are based on the number of teachers who knew whether the 

volunteers assigned to their pupils were trained or untrained. About half of 

those in St. Louis and San Franv-^isco did not know training status; about 20% 

3/ 

and 30% in Denver and Oxford, respectively, did not know. — ^ 

Based on questionnaire and interview comments, teachers generally 
had little information about the content of volunteer training. (Their dissatis- 
faction with this situation has resulted in information about volunteer training 
being made a required part of teacher training for the second year of the project.) 
Nor did they have an opportunity to observe tutoring sessions. Thus their judg- 
ments about volunteer preparation had to be based on effects of tutoring observed 
in the children and on the amount of teacher assistance sought by trained 
versus untrained volunteers. In addition, teachers, as a professional group, 
regard their work as demanding strong skills and thus they would like) / tend to 
favor the idea of training. ORI believes that the latter two factors probably had 
more to do with the difference of opinion reflected in Figure 3.19. 

Statistical tests showed no significant difference in trained and un- 
trained volunteers* impact on children's performance. However, based on 
teacher opinion project-wide, it appears that training volunteer tutors to work 
fairly independently may be important to teacher satisfaction with the project. 
It should be kept in mind that 60% said they considered ihe untrained 
volunteers well prepared. This is a large proportion, although significantly . 
smaller than the proportion who found the trained well prepared. 

3/ 

— The project specification was unclear as to whether teachers should know 
the training status of the volunteers . The high incidence of teachers who 
did not know resulted from project directors* attempts to adhere to the 
project design. "- 
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82% 



60% 



Wed Prepared 



13. Were any trained Upswing volunteers assigned to your pupils? 

a. Yes [1 

(Answer Question 14) 

b. No [ 1 

(Skip to Question 15) 

c. I don't knovy whether the volunteer(s) assigned to my 

pupil(s) were trained or untrained [ 1 

(Skip to question 17) 

14. if yes, how do you feal about the preparation given to these 
trained Upswing volunt06rs?/'C/i(?c/: one) 

a. In my opinion, the trained Upswing volunteer(s) assigned 
to my pupil(s) seemed well-prepared to work as tutors . 

[ 1 

b. In my opinion, the trained Upswing volunteer(s) assigned 
to my pupil(s) did not seem to be well-prepared to work 
as tutors [ ] 

(This set of questions was repeated for untrained volunteers.) 

I I Trained Volunteers 

Untrained Volunteers 



34% 



14% 




Not Well Prepared 



No Response to 
Question 



FIGURE 3.19. TEACHER OPINION ABOUT WHETHER TRAPTED , 
UNTRAINED VOLUNTEERS RECEIVED ADEQUATE 
PREPARATION FOR TUTORING, ALL CITIES 
(Percentages based on numbers of teachers who knew 
that volunteers were trained or untrained.) 
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Table 3.20 shows, some interesting differences between cities. 
St. Louis teachers indicated they found training made no difference. The 
percentages who found trained c^nd untrained volunteers well- and ill-prepared 
are essentially equal. In the other cities 25% to 30% more teachers thought 
the trained were well prepared than held that opinion of the untrained. 

The rates of nonresponse also vary. Apparently Oxford and St. Louis 
teachers felt more confident to make a judgment. ORI interprets the high per- 
centage of nonresponse in San Francisco as a reflection that those teachers 
felt they did not have enough information to make a judgment about adequacy 
of volunteer preparation. However, it would be inappropriate to consider this 
difference particularly important since the numbers of teachers involved are so 
small. For example, two teachers are 17% of the San Francisco population for 
this tabulation . ' ' ' 

0 

( 

Teacher Comments About Volunteer Training 



"What little I did see the tutors looked well prepared." 

"T don't feel that the training given the volunteers made much 
difference in their ability to tutor in my class situation— untrained 
tutors did as well. " 

"They could use more training, always." 

" I feel that I can better train the volunteer because of my knowledge 
of the needs of my pupils . " " 

Trained volunteers are better able to assess needs and use materials 
in more innovative ways," 

"The trained volunteers seemed to have more interest in the child." 
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Relationships of Project ParLicipants 

Volunteer-Pupil Relationship, ^ . Figure 3,20 it is evident that teachers 
believed their pupils responded favorably to the Upswing volunteers. Only a 
negligible percentage of children showed a confused or hostile attitude toward 
their tutors according to teachers. Close to three-quarters of the children 
reported on by all teachers demonstrated a willingly cooperative attitude. 
Table 3.21 suggests that there we^e no important differences of opixiion among 
teachers on this point from city to city. ■ " - i 

Volunteer-Teacher Relationship. Teachers' views of volunteers' attitudes 
toward working with them deserves being recorded to the extent that teacher- 
volunteer interaction rubs off on the children. It was hypothesized that obvious 
cooperation, or lack of it, between these two important people in the school 
life of an Upswing child would affect the child's approach to learning. Txhe data 
indicate that volunteers generally showed positive attitudes toward teachers. 
Figure 3.21 shows, for all cities, 78% of the volunteers described as cooperative 
and 2% as uncooperative, with a 17% "little or no contact" between volunteer 
and teacher. 

Table 3.22 shows that the "little or no contact" response category was 
swelled by St. Louis and San Francisco responses. These two cities adhered 
most strictly to the original project design stipulation that trained volunteers 
should function without teacher guidance. In Oxford, an effort was made to 
foster cooperation between teachers and volunteers, regardless of the latter' s 
training sta s , after it was learned that teachers felt uncomfortable without 
some contacL and "say" in what the volunteers \>7ere doing. Further, Oxford is 
a small town. Many of the volunteers and teachers knew each other outside of 
school. In Denver, volunteers assigned to each school where the project was 
operating provided liaison emong teachers^ volunteers, and the Upswing office. 
They may have promoted more communication than the staff people with other 
professional obligations who performed that function in St. Louis and San 
Frahcisco. 
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10. Th« child's responw to his Upswing 
volunteer seoms to be: 

N 

a. Willing cooperation 

b. Hesitant cooperation ^ 

c. Neutral 

d. Confused 

e. Hostile 



3% 



1% 



Willing Hesitant 
Cooperation Cooperation 



Neutral 



Confused 



Hostile 



FIGURE 3.20. TEACHER ASSESSMENT OF CHILDREN'S 
RESPONSE TO TU''fO:RS. ALL CITIES 
(Nonresponse to question: 1%) 
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11. Which best describes, the attitude of 
this child's yoluntoer toward you? 

a. Cooperative 

b. Uncooperative 

c. We have had little or no 
contact except when the 
volunteer comes to meet the 
child 



2% 

I — I 



17% 



Uncooperative 



No Contact 



FIGURE 3.21. ATTITUDES OF VOLUNTEERS TOWARDS TEACHERS, 
AS ASSESSED BY TEACHERS, ALL CITIES 
(Nonresponse to question: 3%.) 
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Teacher Comments About Their Relationships With Volunteers 



(Teachers did not comment on volunteer-pupil relationships.) 



*' Program created many problems I would not have encountered. There 
isn't time to help volunteers or individual programs and I would pre- 
fer stressing my own/' 

"I found these volunteers to be very enthusiastic, full of ideas, and 
a great help to the childien," 

"We worked together^. I learned some good things from the volunteer,' 
"My volunteers were exceptionally good," 

"They (the volunteers) were very conscientious and used materials 
capably, also were willing to ask for advice and use ideas I might 
have for a particular child." 

1 



^ 
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Teacher Satisfaction 

Figure 3.22 points to a disturbing communications problem in Phase I 
of Project Upswing. About 40% of all teachers involved said they did not clear- 
ly understand Upswing and the part teachers were to play in it. Table 3.23 
shows that this confusion occurred in all cities, with the greatest proportion 
of teachers in St. Louis indicating they felt "at sea" and the lowest proportion 
in San Francisco. 

Phase I teacher preparation was brief and took one of two forms , In 
Denver and San Francisco a meeting was held to explain the project to teachers 
who referred children as candidates for tutoring. Seventy-six percent of the 
Denver teachers who returned final questionnaires said they attended this meet- 
ing and 82% of those in San Francisco said they 'attended . Upswing staff visited 
the schools in Oxford and St. Louis to explain the project to teachers. 

The data suggest that considerable attention must be given to bringing 
teachers into a project like Upswing and making sure they know what responsi- 
bilities they will have. Early feedback resulted in the university project 
directors in each city establishing a 10-hour minimum for teacher orientation/ 
training in the second year of Upswing. Questionnaire comments from both 
teachers and volunteers have been used in planning the content of teacher prepar- 
ation for the project in the second year^ 

Problems with teachers' understanding of the project and thsir role in 
it, along with ca^es of sporadic attendance by volunteers , probably account for 
most of the 22% of teachers (Figure 3.23) who said they would prefer not to 
work with Upswing volunteers again. This was the trend suggested by teachers 
who commented on their feeling in responding to the questionnaire. 

Figure 3.23 shows that 73% of the teachers would want to work with 
Upswing volunteers again, with 67% preferring trained volunteers and 6% prefer- 
ing untrained. Thus, when offered a choice, teachers decidedly, favored trained 
over untrained volunteers. This is consistent with teacher opinion about how 
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23. Do you have a clear understanding of Project Upswing 
what ^;our role in it is suppossd to be? 

a. Yes 

b. No 



40 - 



30 - 



57% 



41% 



Understood 



Did Not 
Understand 



FIGURE 3.22. TEACHERS' UNDERSTANDING OF PROJECT 
UPSWING AND THEIR ROLE IN IT, ALL CITIES 
(Nonresponse to question: 2%.) 
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25. Based on your experience this year, which would you prefer 
to have for your pupils next year? 

a. Trr.lned Upswing volunteers [ 1 

b. Untrained Upswing volunteers [ 1 

c. I would prefer not to have any Upswing volunteers work 
Vt^ith my pupils next year [ 1 



67% 



22% 



6% 



Prefer 
Trained 



Prefer 
Untrained 



Prefer Not To Work 
With Any Upswing 
Volunteer Again 



FIGURE 3.23, TEACHER PREFERENCE ABOUT WORKING WITH 
UPSWING VOLUNTEERS AGAIN, ALL CITIES 
(Nonresponse to question: 5%,) 
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well prepared trained versus untrained volunteers were for their work as 
^-utors (Figure 3. 19 and Table 3.20) . It also would appear to relate to 
teachers' preferences about helping volunteers (assuming they believed 
trained required less direct support) , and most likely to the higher rate of 

attrition for untrained volunteers. | 

/' 

Table 3.24 (at the end of the section) breaks down teacher preferences 
about working with volunteers again by city. The only meaningful difference, 
and a striking one, is that in Oxford only 6% of the teachers (one) preferred 
not \o work with Upswing volunteers again, versus about 25% in all other 
cities. If the one Oxford nonrespondent answered negatively, the percentage 
who did not want to be involved again would still be half that in the other 
cities. This difference is probably related to the personal relationships more 
readily established in a small town; to the team-teaching, more or less op'3n 
classroom approach in both Oxford schools (teachers accustomed to working 
with others and to movement in the classroom); and to the strong effort made 
by the project director and staff to ensure harmony by maintaining unusually 
frequent contact with both teachers and volunteers. 



Teacher Comments Related to Their Satisfaction With Upswing 



" Tutoring had no effect." , 

"Children have more 'self worth' realization." 

"Both David and Cynthia made better progress after their volunteer 
stopped com ing 

"It has been a tremendous help for both these children. It has helped 
us find out many things that will help these children. It was dis- 
covered that one child was perceptually handicapped and will receive 
special training next year," 
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(Teacher Comments F.olated to Satisfaction With Upswing, Cont) 

"I'm completely sold on the -project. The child taking part would not 
have been able to make near the progress in a group situation. The 
trained tutOx^ worked tirelessly in providing experiences beneficial 
his progress. Contact with the directors were helpful and freq^^v^nt, 
I'm very pleased to be in the program this year." 

"The child had quite a problem, but with the help c/ che volunteer, 
progress was made." 

"The child who made greater gains was rjt tutored regularly at all." 

"The trained Upswing volunteer? iielped my students so very much- 
Students who could not writr uheir names in December '71 are now 
ready for second grade." 
« 

"In my classroom this year I have two students who would not be 
moving to second grade had it not been for the faithful work of the 
volunteer Upswing people. It is a great program with lasting possibilities," 

"Upswing gave the boys in my class more time to learn on their own 
level of interest and maturity. They would have lost their desire to 
learn and school could have become a bad experience." 



-Teachers' Understanding of the Project and Their Role- 
"We weren't told anything about the project." 

"I do now (understand my role) . However, it was not made clear at 
the beginning of the project." 

"Not too sure about my role." 

"No one seemed to know what was going on. Thus, this was how 
the whole program was carried out." 
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(Teacher Comments Related to Satisfaction With Upswing, Cent) 



"I -will only participate if I have trained tutors, otherwise it*s 
a waste of time for children involved and myself." 

"All tutors should be trained and screened for reliability." 

"Trained volunteers would be able to get to work and accom- 
plish in the short tinie they are available. " 

"I like the program but I think the chJ.drcn would in most cases 
do better with a trained tutor." 

"I don't care if they're trained or untrained so long as they are 
mature, dedicated, faithful in attendance and don't need a lot 
of guidance . " 
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IV „ CASE STUDIES 



This sec!:ion is included to give fuller, more personal insight into 
the 'vorkings of Project Upswing than is possible from statistical analysis. 
The data were obtained in interviews conducted in April and May 19 72 , by 
the ORI study team, with a random sample of children and their associated 
volunteers and teachers. Thus a complete Upswing relationship is examined 
in each case. The basis for case selection is given a* the beginning of each 
individual analysis. 

BILLY FORTHWRIGHT, AGE 7^ 
R eason for Case Study 

Billy had the largest negative achievement change (WRAT standard 
score) of the children with trained volunteers for whom we have full data. 

Description of Child. Billy is small, slender, and bright-eyed— a 
friendly, high-strung child who appears intelligent but highly distractible. 
His parents are divorced and he lives alone with his grandmother. He is 
presently being treated with drugs for hyperkinesis , but was not at the 
beginning of tutoring. 



Billy seems to feel that the children around him are hostile forces 
that he must guard against. He said that the other children seem to always 
get him in trouble. In fact Billy appeared to have obsessive thoughts about 
other children posing threats to him. Such thoughts were a main source of 
distraction during his interview. This condition could well be caused by his 
phyisical impairments . 

Physical Condition. Billy has a harelip that could make him the 
recipient of much peer disdain or teasing. To complicate matters, he is hard 
of hearing, which is often the cause of anxiety related to peer approval. 
Billy's volunteer reported that he also suffers from a condition that is causing 
gradual blindness. In general, Billy suffers from a complex of perceptual 
difficulties that would make reading hard for anyone. He should not have 
been considered for the Upswing sample; he recjuires special help beyond the 
Upswing volunteer's training. 

Billy's Volunteer^ Mrs. Marouit. Mrs. Marquit became a volunteer 
because she enjoys working with children on a one-to-one basis. Although 
she had no specific ktiowledge of or experience with children having special 
learning problems, she worked previously as a teacher aide and has raised 
four children of her own. 

Mrs . Marquit is over 60 years old and married. She had a few years 
of college, but did not earn a degree. Her husband is a professional with an 
advanced degree. Their family income is above $25,000 per year. 

At first Mrs. Marquit did not feel she needed special training, but 
she was placed in the volunteer group that was to receive training. Nevertheles 
as one might expect, when she started working with Billy she found her training 
inadequate. Most of it was not applicable to her situation. She did find that 
the learning games she was taught in Upswing were helpful. 

Despite her. difficulties, Mrs. Marquit was a faithful volunteer, 
attending most tutoring sessions. She felt that Upswing is important, seeing 
a need for volunteers to provide individual attention because of a teacher 
shortage. She also felt that she could have been more effective with a child 
showing less pathology. - 

4-2 



\ 

V 



Mrs . Marquit was able to establish close rapport with Billy. He 
appeared to trust her. The teacher felt the child benefited by Mrs. Marquit' s 
visits and said he looked forward with great anticipation. 

\ / 
Billy's Teacher, Mrs. Siqel . Mrs. Sigel is about 3 5 years old and 

had been teaching for 1 year before the Upswing experiment. She has her BA 

degree, with six hours of special graduate training in working with children 

who have special learning problems. 

Upswing was Mrs. Sigel' s first experience with volunteers. Upswing 
volunteers were assigned to two of her pupils and she said she enjoyed 
working with them. She felt that they gave her ideas that she could use with 
other children. Her only complaint was that the volunteer schedule was not 
convenient to her, although she hesitated to change that for fear of losing the 
volunteers . / 

Mrs . Sigel felt that Upswing would benefit most children and had only 
a marginal preference for trained volunteers because "they require less 
guidance." She was willing to devote up to 4 hours per week to Upswing 
related activity r In general, it appeared that Mrs. Sigel participated in 
Upswing gladly, feeling that her role was quite clear. 

C hild's Progress . Mrs. Sigel chose Billy for Upswing after only a 
short acquaintence . She felt she may have made a mistake in that his 
problems were quite severe. Nevertheless, l;er first impression of his response 
to the volunteer was that his behavior in class improved, although his readirig 
did not. Mrs. Marquit believes Billy is emotionally disturbed. It appears 
that some of Billy's emotional problem is due to an unusu.^1 form of sibling 
rivalry. His older brother lived with the mother (apparently a favored position) 
This seems to have made Billy feel rejected and severely damaged his self- 
esteem. Having an adult volunteer enter his life, even for only two hours 
per week seems to have helped build up his ego. Later during the year 
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Billy's brother died. This event was followed by a considerable increase 
in Billy's drive to communicate with the volunteer which produced a 
moderate improvement in his ability to express ideas verbally. Billy's 
feelings of self-command were bolstered by the drug treatment of his 
hyperkinesis . The next result was a significantly elevated self-concept 
and increased ability to communicate. 

No improvement in his reading skills was recorded either by the 
teacher, or by the WRAT. All obseivations show that despite the important 
gains noted above, Billy fell further behind in relative class position in 
reading. This is all that could be expected in view of his serious perceptual 
handicaps . 
Conclusion 

If quality of life is relevant to our research (and we at ORI believe 
it is), Upswing was an unqualified success for Billy, even though his readindf 
did not improve. This kind of benefit will not show in the statistical findings 
of Upswing, which deal primarily with testable criteria for success. However, 
the quality of Billy's life has so improved that it is reasonable to expect that 
if he gets proper eyeglasses and a hearing aid, his reading will be up to 
normal in a few years . 

GLENN ARTHOR, AGE 7^ 

Reasons for Case Study 

Glenn had the largest negative achievement change of children with 
untrained volunteers for whom we have reasonably complete data. 

Description of the Child . Glenn is a very slender, hyperactive, 
highly distractible child who appears to have severe emotional problems. He 
has average overall potential, but has poor visual motor coordination. As 
might be expected, Glenn feels very much at the mercy of forces beyond his 
control, both from within (hyperkenesis) and from without (authority figures). 
His reaction to authority appears to be very negative. He has a strong psycho 
logical opposition to anything he sees as "work," which he refuses to attempt 
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This aversion to work is clearly related to the boy's fear of work- 
related failure and expected resulting peer rejection. He says, "I hate to 
do work because they (peers) will think I'm too dumb and think backwards, 
but I don't I" 

His insecurity in the school situation is manifested in primitive 
classroom behavior as well as by withdrawal. . 

Physical Condition , Glenn is in reasonably good general health 
except that he suffers from a nonspecific neurological impairment which causes 
his severe hyperkenesis . He has undergone several drug treatment series with 
only moderate success. This overt condition is the prime reason for his referral 
as an Upswing candidate. 

Glenn' s Volunteer, Mrs . Killinqton. Mrs. Killington became an Up- 
swing volunteer because she enjoys working with children. She has a child 
with a learning disability in her own family which provided her with valuable 
experience she wished to use. In addition, she has been a teacher of elementary 
school children but did not have a job during the 1971-72 school year. Up- 
swing provided herewith an opportunity to get to know the school system. 

Mrs. Killington is 25 years old and married. She has completed 
her BA in teaching and attended graduate school. She tutored for Upswing 
between jobs, and has gone on to be a teaching assistant in the school system. 
While she was with Upswing, she was a faithful volunteer. Mrs. Killington' s 
husband is a construction worker with a high school education. Their family 
income is about $10,000 per year. 

Mrs. Killington feels that she would have benefited from training. 
She feels that Glenn* s problems were so severe that she needed someone to 
consult with her on her activities. She was somewhat insecure in her role 
because she felt torn between working on Glenn's reading or on other problems 
more immediate. She finally decided to work with. Glenn as "a person not an 
experiment." She started working on his motor skills and developing a rela- 
tionship with him. Thus, she was able to establish a meaningful relationship ' 
with Glenn in that he learned to trust her and looked forward to her visits. 
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Glenn's Teacher, Mrs, Farquar , ORI knows very little about Mrs. 
Farquar. Glenn was transferred to her room after two months with Mrs. Valdez. 
Mrs. Farquar, although i"he became an active member of the Upswing movement, 
was not reported to ORI as an Upswing teacher. Thus, she did not receive any 
of the Upswing questionnaires. Nevertheless, Mrs. Killington describes her 
(Mrs. Farquar) as a warm, competent teacher, who took time to discuss Glenn's 
problems and progress. Glenn's original teacher, Mrs. Valdez, did not feel 
that the Upswing movement was likely to succeed. Her attitude appears to 
have been generally negative. It is therefore, probably fortunate that Gl'enn 
was transferred. 

Child's Progress . Glenn could not be expected to function effectively 
in a normal classroom. His overt behavior symptoms make him stand out as an 
object of ridicule. His resultant emotional reaction has been to avoid teasing 
by avoiding failure by avoiding "work*" He was selected for Upswing for 
wrong reasons — his behavior. His problems are far more severe than Upswing 
was designed to deal with. Nevertheless, Glenn has made significant progress, 
but not in reading. 

The interest Mrs. Killington showed in Glenn has helped him overcome 
some of his hostility toward authority figures. It appears that Glenn has been 
able to increase the size of his vocabulary and has taken an interest in sound- 
ing out new words. Much progress appears to be related toXGlenn's drug 
therapy. As one would expect, his performance is inversely Related to his 
level of hyperactivity. In addition, Mrs. Killington has helped to get Glenn 
into a speech therapy group and a remedial reading class. 
Conclusion 

' It is clear that Glenn's progress in the classroom will be poor at 

best until some means is found to fulfill his deep need for peer acceptance 
and self worth. Upswing was a total failure with Glenn if you consider only 
measurable criteria such as WRAT scores, or even classroom performance. 
Glenn, however, found a friend, probably his first, who believed in him and 
liked him. He liked that. 



MICHAEL (MIKE) EDWARDS, AGE 6 

Reason for Case Study 

Mike had the largest positive achievement gain among the children 
with trained volunteers for whom we have complete records. 

Description of Child, Mike is a shy boy of average ability, who appears 
to be moderately hyperactive. He is an eager boy whose enthusiasm for learn- 
ing has grown with Upswing. Mike was able to read a little, with help, at 
the beginning of the project, and was able to establish a comfortable relation- 
ship with his tutor. It is somewhat difficult to understand what criteria Mike's 
teacher used in selecting him for this project. Perhaps she was concerned 
about his shyness mo^^e than his reading. 

Physical Condition. Except for mild hyperactivity, Mike is in good 

health. 

Mike's Volunteer, Mrs. Donker . Mrs. Donker ir a 58-year old home- 
maker who has no previous training or experience with children having special 
learning problems. She volunteered because the idea of catching these problems 
early, before they become serious, was a good idea, Mrs. Donker is married 
to a professional man whose income 13 over $25,000 per year. They have raised 
two children who are no longer in the home. This fact has provided the spare 
time needed to prepare for tutoring activities. 

Mrs. Donker was an intelligent, sensitive, and enthusiastic volunteer 
who prepared les son3-' in, advance, ^ but was flexible enough to abort her plans 
when necessary. , She f^'lt fru'strated by the short-term intensity of training, 
and suggested that more\f it should come as inservice training. She found 

DISTAR too cumbersdme toNyse and resorted to her own mixture of using class- 

\. 

room materials, writing and\telling stories, flash cards, and games. She 

;\ 

feels that, in the first few weeks, the tutor should devote one hour per day 
to the child in order to establish an "easy rapport which can turn into early 
success." Mrs. Donker was able to establish an easy rapport with Mike, 
who seemed to have been enthusiastic about their meetings. The boy's teacher. 



however; saw Mrs, Donker as a "pain in the neck and uncooperative." For 
unknown reasons ; Mrs. Donker dropped out of Upswing in March 19 72 . 

Mike's Teacher; Mrs. Wolper . Mrs. Wolper is about 35 years old; 
and has been teaching 6 years. Five of those years have been spent as a 
first-grade teacher.. She has had one course in education of children with 
learning problems and also a supplementary workshop. In addition; she has 
had experience working with volunteers. 

In general; Mrs. Wolper expressed contempt for Project Upswing 
calling it "a miserable flop." Overt hostility towards the volunteers has 
been evident; she refused to aid them in any way. She considered one volun- 
teer to be a "nuisance" and another to be a "pain in the neck." There is 
reason to believe that Mrs. Wolper is a reasonably good teacher; but she 
manifests great insecurity as a teacher; resenting any implication that she 
may need help. She complains that volunteers do not understand the problems 
a teacher has to deal with; but makes no attempt to discuss such problems 
with the tutor. In the final contact she claimed that the children didn't 
really need help to begin with; and that they had made no special progress 
under tutors . 

Child' s Progress . Mike v^as perhaps chosen for Upswing for the 
wrong reasons. He was reading (with help) from the beginning. It appears 
that he had a problem with verbal communication. ThuS; Mrs. Donker decided 
to make "independent reading" her goal for Mike by the end of the term. 

At the beginning of the year Mike was afraid to make mistakes and 
thuS; hesitant to become fully involved in the tutoring process. Nevertheless; 
as time progressed; Mrs. Donker was able to gain the troy's trust. He relaxed 
and began to show an eagerness for learning. The individual attention seems 
to have sparked an increase in Mike's feeling of self worth. His peer rela- 
tionships do not seem to present problems and his academic progress has 
probably been greatly accelerated. As might be expected, there is a serious 
discrepency between the test results and teacher observation. Test scores 
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show dramatic improvement, while teacher observation shows the boy falling 

behind . 

Conclusion 

Mike Edwards derived significant social and academic benefit from 
Project Upswing. It is interesting that such progress was possible under the 
worst conditions of volunteer-teacher relationship • It is, unfortunately, 
possible that seme of Mike's great gains could be due to an excess of atten- 
tion from a highly competitive, threatened teacher out to prove her own self 
worth. This is s^peculation , however, and cannot be substantiated by the 
evidence at hand. 

PARNELL BEAUFORD, AGE 6| 

Reason for Case Study 

Parnell had the highest increase of the children with untrained volun- 
teers for whom we have reasonably complete data. 

Description of Child . Parnell is a friendly, cooperative child who 
related well to adults. He is of borderline low-average intelligence, and has 
good visual motor coordination* It is interesting to note that although Parnell' s 
IQ measures quite low, he seems to be a reasonably bright child. He has 
a good attention span, manifests social confidence. 

Physical Condition. Parnell is in good health. 

Parnell' s Volunteer, Miss Blue. Miss Blue was under 21 years old, 
and a junior at the University. She is not married. At the time she volunteered, 
Miss Blue had no experience or course work in working with children with 
special learning problems. Miss Blue wanted to receive Upswing training, 
but her schedule did not allow time for it, so she became an untrained volun- 
teer even though she attended a few training sessions. 

Miss Blue is an enthusiastic young volunteer v/ho appears intelligent 
and sensitive to children. She was raised in a culturally rich atmosphere by 
a reasonably well-to-do family. 
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At first Miss Blue felt "sort of lost" as a tutor, but with the teacher's 
help she gained confidence. 

Parnell's Teacher, Miss Deposit, Miss Deposit has had long experi- 
ence in teaching. She has taught 24 years in all, 18 of which have been in 
first grade. She is in her late 40s and appears to enjoy teaching young 
children. In addition. Miss Deposit has shown marked enthusiasm for Project 
Upswing. She has had several undergraduate courses in work with children 
having special learning problems and has had previous experience with tutors. 

Miss Deposit feels that Upswing volunteers require little supervision, 
at most 1 hour per week. She was willing to discuss child progress and help 
coordinate tutoring and classrobm activities and provide untrained volunteers 
with work sheets and other materials. 

In general Miss Deposit participated in Upswing gladly, feeling that 
her role was to help the project be a success. 

Child' s Progress . It appears that Parnell was chosen for Upswing 
primarily because of his confusion over verbal instructions and his early 
difficulty with reading. His VMI scores were average and he is not hyper- 
active. He gave willing cooperaticpn to the volunteer from the very beginning. 
Pfirnell was willing, but not enthusiastic, about missing class activities for 
the tutoring sessions. Miss Blue has spent most of the tutoring time working 
on class-related activities, but has also taken Parnell for walks and other 
unstructured activities. 

Miss Blue feels that Parnell has expressed himself freely throughout 
tutoring, but appears to lack self-confidence. She feels that the boy is highly 
distractable and has seen little improvement in this area. Parnell still has 
problems understanding verbal instruction, and in expressing himself clearly, 
but he has made great strides of improvement in sounding out new words, 
and understanding what he reads and in increased vocabulary.*^ 



It is interesting to note that he can comprehend more in reading than he 
can in conversation. This is a strong indication of auditory aphasia (word 
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Despite difficult tutoring conditions, (a dark, noisy, basement storage 
room with constant interruptions), Parnell seemed to enjoy his sessions and 
profit from them. His teacher saw significant improvement in the area of read- 
ing, language skills, ability to express himself in class, and self-esteem. In 
general, he has advanced in all subjects towards the class average. Parnell 
also paid more attention in class. The WRAT post-test indicates that Parnell 
is up to national averages in reading performance, a feat one would find improb- 
able for a child with an IQ of 75. Parnell' s true IQ is probably a good deal 
higher, but performance is down due to his perceptual handicaps. 
Conclusion 

Parnell is one example of a child who might have been tracked into 
the lower academic expectancy groups either formal or informal because of low 
measured IQ. Upswing has helped Parnell to elevate his personal performance 
and esteem." It has also helped to enlighten the school system about his 
unusual performance^. Parnell' s volunteer has been able to teach. Miss Blue, 
who wants to be a teacher, has gained valuable experience and confidence. 
Miss Deposit has found a useful resource to help her do a better job.^But, 
most importantly, despite an auditory perceptual block, Parnell has been able 
to learn, more than anyone expected. 
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deafness). In such cases the child often does better on written group IQ 
tests than he would in the Slossen individual test which relies heavily on 
verbal interaction. 
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V. COST-EFFECTIVENESS ANALYSIS OF PROTECT 
UPSWING'S FIRST YEAR 



PURPOSE 

This section is desigiied to look at the cost of having a trained and 
an untrained volunteer tutor a first-grade child who has learning problems, 
in relation to the gains tnat can be expected for the child as a result of tutor- 
ing, ORI has computed the relative total cost for each volunteer group per 
unit of achievement gain. We also estimated the approximate increase of 
volunteers and children the present budget could accommodate, describing 
the marginal cost to add one more volunteer to the project after saturation 
under present funding. 

METHODOLOGY 

The total cost incurred for Project Upswing's operation was distributed 
among the following: 

• Trained volunteers who tutored for the whole year 

• Untrained volunteers who tutored for the whole year 

• Trained volunteers who attrited during the year 

• Untrained volunteers who attrited during the year. 
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These costs were calculated based on the percentage of volunteers who were 
involved in the project at the time the costs were incurred* All costs were 
calculated for each city and were averaged to simplify the discussion. 

In figuring the dollars spent for each volunteer group, the cost 
categories were split into direct and indirect costs . 

Direct Cost ' 

The direct costs were those incurred in providing direct services to 
volunteers. Some pertain to trained and untrained volunteers together, some 
just peitain to the trained, and some just pertain to the untrained, (Remember 
that these costs include those volunteers who attnted throughout the year.) 
Table 5.1 shows how the costs were distributed by category. The costs were 
calculated based on the percentage of time (man-hours) the Upswing staff spent 
on each task (except the cost of materials, which did not involve staff time'} . 

Indirect Cost \ . 

The indirect cost consists of such things as internal evaluation time, 
child testing, teacher fees, and fringe benefits for project staff, as well as 
portions of the cost of project management and secretarial time. These costs 
were distributed ovi the basis of the number of volunteers participating during 
the 10-month span of the project. For example, a fifth of the indirect cost was 
distributed among ail volunteers who were still in the project between November 
and December. 

Marginal Cost 

The marginal cost was calculated on the basis of what costs were 
considered to be variable. The cost-per-volunteer in each category considered 
variable was computed. These were added to give the marginal cbst. This 
was done for both trained and untrained volunteers. 
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TABLE 5.1 



DISTRIBUTION OF DIRECT COSTS 
TO THE VOLUNTEERS 



Direct Cost 
Categories ' 


Trained 


Untrained 


Recruitment 


X 


X 


Management and opera- 
tions of project 


X 


X 


Secretarial 


X 


X 


Preservice training 


X 




Inservice training 


X 




Supervision and 
assistance of 
volunteers 


X 


X , ' 


Materials 


X 




Orientation for untrained 




X 



o 
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DATA SOURCE 

A cost analysis form was sent to the Upswing project director in each 
city at the end of the first year. (See Appendix for copy of form) . The directors 
were to include estimates of the percentage of time spent on the project for 
each siaff member, the cost of materials, and miscellaneous expenses incurred 
in the project. 

SUMMARY OF FINDINGS FROM THE COST ANALYSIS 

The cost analysis for Project Upswing's first year revealed the 
following: 

• Trained volunteers clearly cost more than 
untrained volunteers. 

• The cost per mean point gain in achievement 

is considerably higher when a trained volunteer 
is used than when an untrained volunteer is 
used.— 

• The marginal cost for a trained volunteer 
was about seven times as great as the 
marginal cost for an untrained volunteer. 

COST OF A VOLUNTEER 

As expected, a trained volunteer cost more than an untrained 
volunteer in the first year of Upswing. This was partly because of the cost 
of training and partly because the Upswing staff generally spent more time 
in guiding and supervising the trained volunteers throughout the year The 
dollar amount spent for each trained and untrained volunteer were as follows: 



In Section II of this volume it is pointed out that there was no significant 
difference between the reading achievement gains of children tutored by 
trained and. by untrained volunteers. 
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Volunteer Category Cost Per Volunteer 

Trained volunteer $377 
Untrained volunteer $213 

The data show over a $150 difference in the amount of money spent for a 
volunteer of each kind. 

Losing a trained volunteer was also more expensive. The dollar 
loss when a trained volunteer attrited was almost 3 times the loss incurred 
when an untrained volunteer attrited: 

Volunteer Category Cost Per Volunteer 

Attrited trained volunteer $268 
Attrited untrained volunteer $ 92 

Marginal Cost 

The city directors were asked to estimate the number of additional 
children that could be supported within their 1971 -72 Upswing badgets. The 
average from the four cities indicated that 70 more children could be tutored 
beyond the 100 called for in the project design. This means that the cost of 
the project would not be affected until a volunteer was recruited to tutor the 
171st child. 

The cost of bringing in an additional volunteer, beyond the limit of 
170 under the 1971-72 budget, was computed from the estimated amount spent 
per trained or untrained volunteer in each of tllie cities. The variable cost 
categories listed in Table 5.2 were used to compute the marginal cost of 
having a child tutored by an Upswing volunteer. Summing the columns, it 
turns out that to add one more tr^.ined volunteer to the project would cost about 
$219, while to add one more untrained volunteer, it would cost $31. 
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TABLE 5.2 
ALLOCATION OF VARIABLE COSTS 



Variable Cost Category 


$ Cost/ 
Trained Volunteer 


$ Cost/ 
Untrained Volunteer 


Materials 


46 




Supervision and assistance 
to trained 


79 




Supervision and assistance 
to untrained 




19 


Tra ining 


82 




Management and operations 
of project 


12 


12 


Total 


$ 219 


$ 31 
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COST-EFFECTIVENESS 

Section II of this volume indicated that the mean standard score of 
tutored children went from the low-average range to the average range on the 
WRAT over the school year. The mean point gain was 7 points for children 
who had trained volunteers and 8 points for those who had untrained volunteers. 
The Student's T-test showed that the differences in amount af score change 
between the two groups of children were not statistically significant; i.e. , 
training apparently made no difference in the volunteer tutors' effectiveness. 

From Table 5.2, the cost to go up one WRAT standard point was $55 
for children who had trained volunteers and $27 for children who had untrained 
volunteers. That is, the cost per unit of gain was approximately twice as 
high for the trained than for the untrained volunteer. 



TABLE 5.3 

COST OF TUTORING PER MEAN POINT GAIN 
IN READING SCORE 





Mean Cost/ 


Total Mean Point 


Cost/Mean 


Volunteer 


Tutor 


Gain on the WRAT 


Point Gain 


Trained 


$377 


7 


$55 


Untrained 


$213 


8 


$27 



From the. facts presented in this section, it appears that it is not monetarily 
sound to have trained volunteers tutor children when the untrained do as well 
and cost less . 



All volunteers that have been recruited into the second year of Upswing 
have received training. The decision to train all was made prior to the filial 
results reported here. ORI feels that this decision made by city directors v^as 
justifiable. We have stated that teachers said they preferred to work with 
trained volunteers; volunteers preferred to be trained; training evidently 
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contributed to volunteers' commitment to the project; and, most importantly/ 
it iS agreed that many improvements could be made in the content and format 
of training given in the first year. From volunteer and teacher questionnaire 
responses and from ORI's sample of interviewees, the training was reported to 
be too general, the materials that the volunteers were trained to use were not 
designed for one-to-one instruction, and volunteers wanted more specific 
help in diagnosing their pupil's problems. ORI is evaluating the training 
given in the second year in depth to determine the effects of improvements in 
that area on the tutored children's achievement. Since there will be no 
comparison groups. of volunteers and children for the Phase II evaluation, we 
will consider training as part of the overall project design and operations in 
each city, which ^can be compared with the project approach used in the first 
year. ^ 
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VI. ANALYSIS OF VOLUNTEER ATTRITION 



PURPOSE 

Attrition is a very important factor in the management of any volunteer 
program. It is essential to know whom to recruit and whom not to recruit to 
ensure a successful tutoring program. , 

This section first presents the attrition rates and then describes the 
volunteers who left Project Upswing during the course of the 1971-72 school year 
in terms of when they dropped out, reasons given, and personal characteristics. 
The analysis attempts to relate these factors, and also considers the possible 
impact of recruitment timing and procedures on attrition. Conclusions concern- 
ing attrition are presented at the end of the section. 

DATA SOURCES j . . 

The data presented in this section were taken from: 
• Information about recruitment procedures 

gatherjed by ORI during site visits and from 

I 

the university project directors' mid-term 

report^ 

I 

m The Upswing Volunteer Attrition Report form, 
which iincludes training status and date and 
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reason for leaving 

• The volunteer registration form (for personal 
background information) 

• Questionnaire comments and volunteer 
interviews . 

ORI made initial site visits to each of the Upswing cities, obtaining 
detailed information on recruitment procedures.-^ Also, the city project 
directors included a section on recruitment in their mid-project reports. This 
information will be used in conjunction with the causes and timing of attrition. 

The attrition card (see Appendix) was a prepaid, self-addressed post- • 
card that was to be rp;^iled directly to ORI as soon as a city was notified that 
a volunteer had dropped out. The form includes the training status of the 
volunteer and the date and reason for leaving. ORI ran into some difficulty 
throughout the year getting complete data. See "Parameters of the Population" 
for further discussion. 

A separate computer run was made from the volunteer registration form 
data to secure a profile of only those volunteers who dropped out of the project. 
The profile is not as detailed as the profile of all volunteers,-^ since only 
certain items are of interest in this analysis. 

Questionnaire comments and volunteer interview comments were used 
to clarify and substantiate data when needed. 

PARAMETERS OF THE POPULATION 
f 

At the start of the 1971-72 year ORI requested that the city directors 
complete an attrition card for a volunteer who dropped out only if she (he) had 

See QRI's Evaluation Of Project Upswing , Interim Report, TR No. 700, 
January 1972 . 

2/ 

See ORr*s Final Report on the Evaluation of Project Upswing's First Year , 
Volume I: Profiles of Participants and Their First Impressions of the 
Project, ^R 731 , July 1972 . 
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filled out the volunteer registration form. It was felt that these people who 
actually registered could be truly considered part of the Upswing project. 

It is OKI's understanding that the city sLaffs lost contact with some 
of the volunteers and thus could not get the necessary attrition information. 
Volunteers failed to notify the project staff that they were quitting and the 
schools did not always report it when volunteers failed to come or stopped 
coming. Telephone calls were made to collect {he necessary attrition information 
from known attritees, but these efforts were at times unsuccessful. That is why 
a large percentage of the volunteers had "unknown" listed hs reason for leaving. 

Table 6.1 shows the number of registered volunteers, by status group 
(trained and untrained), each city had at the start of tutoring versus the number 
of attritees. It also gives these data for the project as a whole. Denver, 
Oxford, and San Francisco had very similar rates of attrition for both trained 
and untrained volunteers. St. Louis had somewhat lower rates, especially for 
the untrained group « Attrition among untrained volunteers was significantly 
higher in all cities. This is reflected in the Total row of Table 6.1, where 55% 
attrition is shown for untrained versus 33% for trained volunteers. 

SUMMARY OF FINDINGS IN THE ANALYSIS OF VOLUNTEER ATTRITION 

• Attrition was significantly higher among untrained 
volunteers. This is largely attributable to a 
heavier concentration of college students in that 
group, although even among students, the un- 
trained dropped out more often. ORI believes 
that untrained volunteers, as a group, felt 

less strongly committed to the project then 

i 

trained volunteers. 

• Attrition peaked for untrained volunteers between 
the time of registration and the start of tutoring , 
and again in February.- Attrition peaked in 
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TABLE 6.1 

DISTRIBUTION AND ATTRITION RATE OF 

PROJECT UPSWING VOLUNTEERS, 
TRAINED AND UNTRAINED, BY CITY 



City 


Trained 


Untrained 


Registered 


Dropped Out 


Registered 


Dropped Out 


Denver 


68 


24 (35%)* 


48 


29 (60%)* 


Oxford 


50 


17 (34%) 


52 


30 (58%) 


St. Louis 


55 


14 (25%) 


46 


19 (41%) 


San Francisco 


50 


19 (38%) 


38 


23(61%) 


Total 


223 


, 74 (33%) 


184 


101 (55%) 



Percentages of total number of volunteers who registered. 



't 
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February for trained volunteers. These data 
suggest (1) that untrained volunteers may have 
lost interest or made other commitments during 
a rather long waiting period while the other group 
was being trained and the children were being 
identified and tested; and (2) that changes in . 
college students' class schedules were a 
significant cause of attrition. 

• Volunteers' stated reasons for dr;opping out of 
Upswing point to external causes rather than 
to dissatisfaction with the project. 

o Age was related to attrition, but student status 
appears to have been a strong mediating variable. 
Volunteers under-21, and to a lesser extent, those 
21-30, were over-represented in the attrition pop- 
ulation. Volunteers '41-50 years old were somewhat 
under-represented in the attrition population. 

• Homemakers had the most staying power. The 
percentage of homemakers in the attrition pop- 
ulation was lower than the percentage of home- 
makers in the original population. 

• Volunteers in all other occupational categories, 
except student, (i.e. , retired, full-time emp^loyed, 
and part-time employed), were represented in the 
attrition population at about the level they were 
represented in the original population. 

• College students were heavily over-represented 
in the attrition population. 

• Neither previous training in child development nor 
previous relevant experience (as a tutor, teacher 



6-5 



aide, or teacher) appeared to have any 
bearing on volunteer attrition. 

DATE OF TERMINATION 

From Table 5.2, the highest percentages of untrained volunteers drop- 
ped out before tutoring began and in the month of February; almost a quarter, 
of the total of untrained attritees (13% of those who registered) dropped out 
each time. Attrition among the trained peaked in February; 22% of trained 
attritees (7% of trained volunteers who registered) left during that month. 

Denver, St. Louis, and San Francisco started to recruit volunteers 
in the early fall (August and September.) Oxford begap much earlier* Volun- 
teers did not begin tutoring in any city until mid or late November. During 
this 3- to 5-month time span, there was little contact with untrained volunteers 
except for 10 hours of orientation. It is likely that some got tired of waiting or 
perhaps felt the project was not going to get off the ground. This would account 
for greater attrition in the untrained group before tutoring began. Oxford only 
had one person drop out of the project at this time, although recruiting began 
there earlier than in any other city. It should be understood, however., that 
the situation in Oxford is unique. The city is small and the project director 
and staff knew each other. The people were probably informed of the status 
of the project and were personally encouraged to wait until November to start. 

As noted above, during the month of February, 22% of the trained and 
24% of the untrained attritees dropped out of Project Upswing. Table 6.2 
shows these high rates attributable to losses in Oxford, particularly the untrained 
volunteers. College, students made up 70% of Oxford's original volunteer 
population. They were about evenly divided between the trained and untrained 
groups. The new semester at the university began in February, and a great 
many students had to step at that time because of change in class schedule 
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or other commitments-. Fifty-thit;e percent of Oxford* s trained attritees quit in 
February, along with 67% of its untrained attritees (1.8% and 58%, respectively, 
of the city's original groups.) In January, 41% of Oxford's trained attritees 
dropped out (14% of trained volunteers who registered.) Their reasons for 
leaving (Table 6.3, page 6-lG)and information from the prpject director show 
that most of these attritees were seniors in the University of Mississippi's 
ochool of Education who had to practice teach beginning in January. Seventeen 
percent of Oxford's losses,_Jrom the untrained group occurred in January (10% 
of the original group.) 

St. Louis shows some interesting differences from the other cities in 
Table 6.2. That city lost 53% of^its untrained attritees before tutoring began. 2/ 
This high rate of loss is difficult to interpret except as a function of minimal 
contact with the untrained volunteers during the waiting period between recruit- 
ment and tutoring. It also could be that the St. Louis staff had registration 
forms filled out more promptly than other cities, so that more people were 
counted 3s members of the population. The next most common months of 
attrition for untrained volunteers in St. Louis were December and January, 
suggesting possibly, the impact of the holiday season. 

St. Louis had an extremely even distribution of trained volunteer attri- 
tion over the year. This is an unusual occurrence for which we have no explana- 
tion . 

Thirty-nine percent of San Francisco's untrained attritees left the 

project before tutoring began and 17% left in the first month of tutoring. Together, 

1 

these volunteers represent over half of all of that city's untrained attritees. 

3/ As noted previously St. Louis had a lower rate of attrition among untrained 
volunteers than any other city. The 53% represents 10 untrained volunteers 
lost before tutoring began. 
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Over half of San Francisco's trained attrltees left in the first 2 months of 
tutoring— November and December. 

The high incidence of early attrition here, as in St. Louis, could be 
related to the waiting period. It also could be related to turbulence surround- 
ing busing to desegregate the San Francisco schools. Another possible factor is 
that in San Francisco volunteers were generally assigned to the trained or un- 
trained group rather than allowed to choose. Although ".he reasons for leaving 
do not indicate this, it could be thai some volunteers quit because they were 
dissatisfied with their assignments. It should be noted that San Francisco's 
procedure was as calJed for in the project design; the other cities skirted this 
requxfement for fear of losing volunteers . 

REASONS FOR TERMINATING TUTORING GIVEN BY VOLUNTEERS 

Table 6.3 shows a by-city breakdown of trained and untrained volunteers' 
reasons for leaving Project Upswing. As in Table 6.2, the table's percentages 
are based on numbers of attritees rather than numbers originally in the trained 
and untrained groups. 

The percentage of unknown reasons for untrained volunteers' leaving is 
much greater in all cities than the percentage of unknowns for trained. This 
reflects the fact that the project staffs had less contact with un^'rained volunteers, 
in accordance with the project design. Because of i:he large percentages of 
reason-unknown cases, togelther with the variability of reasons given, it is 
difficult to interpret these data beyond saying that they suggest attrition was 

rarely caused by some aspect of the project experience. Th. > may or may not 
be true; nevertheless, nearly all reasons given were beyond project control. 
The only apparent trend is that untrained volunteers, everywhere but in St. 
Louis, gave "no time*' as their reason for leaving more commonly than trained 
volunteers. This is liKely an indication of less commitment to the project 
on the part of untrained volunteers. 

The volunteers from Denver gave a wide variety of reasons for leaving. 
The most common for both the trained and untrained groups were volunteers either 
had no spare time for the project, became employed, or moved from the Denver 
X • / 6-9 



TABLE 6.3 

VOLUNTEERS' REASONS FOR LEAVING PROJECT 
UP.=rWING, BY CITY . 



Reason 


Denver 


Oxford 


St .Louis 


Sf^n Francisco 


Total 


T 


U 


T 


U 


T 


U 


T 


U 


T 


U 


Unwilling co work in 


0 


0 


0 


0 


2 


3 


0 


0 


2 


3 


assigned school 


0% 


0% 


0% 


0% 


14% 


16% 


0% 


0% 


3% 


3% 


No spare time 


3 

13% 


6 

22% 


0 

0% 


3 > 
10% 


0 

0% 


„ 0 
0% 


1 

5% 


4 
18% 


4 

5% 


13 

13% 


Transportation problems 


1 

4% 


0 

0% 


0 

0% 


0 

0% 


0 

0% 


1 

5% 


0 

0% 


1 

4% 


1 

1% 


0 

2% 


Can't get along with child 


1 

0%- 


0 ■ 
0% 


0 

0% 


0 

0% 


0 

0% 


1 

5% 


1 

5% 


0 

0% 


1 

1% 


1 

1% 


Can't get along with 


1 


1 


0 


0 


0 


0 


0 


0 


1 


1 


teacher 


4% 


3% 


0% 


0% 




0% 


0% 


0% 


1% 


1% 


Child moved 


4 

17% 


1 

3% 


0 

0% 


0 

0% 


0 

0% 


0 

0% 


0 

0% 


2 

9% 


4 

5% 


3 

3% 


Change in class schedule 


0 

U /o 


0 

no/ 


3 

TOO/ 

lo ^ 


22 

73%. 


0 

0% 


0 

0% 


1 

5% 


1 

4% 


4 

5% 


23 
23% 


Practice teaching 


■ 0 
0% 


0 

0% 


10 

59% 


0 

0% 


0 

0% 


0 

0% 


0 

0% 


G 

0% 


10 
14% 


0 

0% 


Illness in family 


1 

4% 


1 

3% 


0 

0% 


0 

2% 


3 

22% 


1 

5% 


1 

5% 


2 

9% 


5 

7% 


4 

4% 


Illness of volunteer 


2 

8% 


0 

0% 


0 

0% 


2 

7% ■ 


3 

22% 


1 

5% 


2 

11% 


1 

4% 


7 

10% 


4 

4% 


Pregnant, adopted child 


i 

4% 


0 

0% 


1 

6% 


0 

0% 


0 

0% 


1 

5% 


0 

0% 


0 

0% 


2 

3% 


1 

1% 


Employment 


6 

25% 


2 

7% 


2 ^ 
11% 


0 

0% 


2 

14% 


2 

12% 


6 

32% 


1 

4% 


16 
21% 


5 

5% 


Volunteer moved 


3 

13% 


7 . 
24% 


1 

6% 


0 

4% 


2 

14% 


0 

0% 


2 

11% 


1 

4% 


8 

11% 


8 

9% 


Confusion of assignment 


0 

0% 


2 

7% 


U 

0% 


0 

' 0% r 


0 

0% 


0 

0% 


2 

11% 


2 

9% 


2 

3% 


2 

2% 


Unknown 


2 

8% 


9 

31% 


0 

0% 


3 

10% 


2 
14% 


9 

47% 


3 

16% 


8 

35% 


7 

10% 


29 
29% 


Total 


24 


29 


17 


30 


14 


19 


19 


23 


74 


101 


100% 


100% 


100% 


100% 


100% 


100% 


100% 


100% 


100% 


100% 
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area. Another reason important only for trained volunteers, was "child moved." 
The Denver metropolitan area is known to have a high percentage of migrant 
families. This probably was the cause of the 17% of trained volunteers dropping 
out because their pupils either moved out of the city or to another school. 

"Child moved" was given as a reason for leaving by only one untrained 
volunteer (3% of the untrained attritees.) One can speculate that if we had 
information for the reason-unllnown cases (31%) there would be an increase in 
the percentage of ui.trained attritees who dropped out because their pupils moved. 

It is also noteworthy that the percentage of untrained attritees who 
said they did not have time for tutoring was almost twice as great as the per- 
centage of trained attritees who gave that reason. These data can be accepted 
as valid indicators because the weight of reasons unknown is on the untrained 
side. ORI believes that training, and more frequent contact by project staff 
with trained volunteers, made a difference in choices between Upswing and 
other uses of time. 

Students composed about 70% of Oxford's volunteer population. From 
Table 6.3, they represented the majority of people who attrited in that city. 
Seventy-three percent of'6xford's untrained volunteers who attrited said they 
did so because of a change in class schedule; 77% of the trained said they left 
either for practice teaching (59%) or because of a change in class schedule 
(18%), The practice teaching factor accounts for the much higher proportion of 
trained volunteer attrition in Oxford during December and January (Table 6.2), 
since second-semester practice teaching begins in January. 

Oxford, however, recruited volunteers to replace 25 of the 30 untrained 
volunteers who dropped because of the class schedule at the university or for ; 
other reasons. Trained volunteers of course could not be replaced. Oxford 
was the only city that replaced volunteers. 

Table 6.3 also shows that Oxford *had a 'comparatively low percentage 
of reason-for-leaving-unknown cases among untrained attritaes and, none among 
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trained. This is another reflection of the degree of communication possible in 
a small community. 

Oxford, like Denver, shows untrained attritees apparently having more 
time problems than trained. Ten percent of Oxford's untrained volunteers who 
left the project said they did so because they had no spare time. None of the 
trained attritees gave that reason. 

No important trend was apparent in the reasons for leaving given by 
St. Louis volunteers. Variations of reasons went from illness in the volunteer's 
family to securing full-time employment. St. Louis was the only city in which 
volunteers stated they were unwilling to work in their assigned schools; 14% 
of the trained attritees and 16% of the untrained felt that way (2 and 3 volunteers, 
respectively.) . , 

Wid'^spread disparity in reasons for leaving the project also occurred 
in San Francisco. Becoming employed was the major reason the trained volun- 
teers left Upswing (32% of trained attritees gave this reason.) As in Denver 
and Oxford, untrained volunteers said they quit for lack of time far more 
commonly than trained. Almost four times as great a percentage of San Francisco's 
untrained attritees gave this reason for quitting (18%, versus 5% of the trained 
attritees .) 

PERSONAL CHARACrrlRISTICS OF VOLUNTEERS WHO ATTRITED 
Age 

Figure 6.1 shows the percentages in each age range of volunteers who 
attrited. They were computed from the original number of registered volunteers 
in each of the age ranges. The figure clearly indicates that the younger volun- 
teers contributed most heavily to attrition. 

Sixty-three percent of the volunteers who were under 21 left the project 
and 50% of those between the ages of 21-30 quit. There was also a peak in the 
51-60 age range; 40% of that group dropped out. Approximately a quarter to a 
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n = 55 
63% 



n = 52 
50% 



n = 17 
40% 



n = 20 
34% 



n = 22 
28% 



n = 9 
26% 



Under 21 
N = 88 



21 -30 
N = 104 



31 -40 
N = 59 



41 - 50 
N = 78 



51-60 
N =42 



Over 60 
N = 35 



FIGURE 6,1. COMPARISON ON AGE OF VOLUNTEERS ORIGINALLY 
IN UPSWING AND THOSE WHO DROPPED OUT, 
ALL CITIES 

(Number of attritees (n) given above each column;, number of volunteers 
in age range who registered (N) given below. Percentage based on the 
N for each age category.) 
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third of the original population in all of the other ag'^ groups dropped out. 

Figure 6.2 shows the age distribution of volunteers who attrited by 
status group. The percentage of untrained volunteers under 21 who dropped out 
was almost twice as great as the percentage of trainee under 21 who dropped 
out (38% and 22%, respectively.) The volunteer profile from Volume I of the 
evaluation indicates that close to 100% of people under 21 were college students 
and that there were more than twice as many of these people in the total un- 
trained population as in the ^trained. Thus students under 21 account for the 
higher percentage of untrained volunteers who dropped. The figure shows 
similar losses of trained aiid untrained volunteers in all other age groups. 

Comparison of Figure 6.2 with Table 3 .2 from the original profile of 
volunteers in Volume I (page 3-8) shows that both trained and untrained volun- 
teers under 21 were over-represented in the attrition population. They repre- 
sented 14% (T) and 31% (U) of the original groups, but 2 2% (T) and 38% (U) of 
attritees. Volunteers in the 21-30 age range also were over-represented, but 
to a somewhat lesser extent. They made up 2 7% (T) and 2 4% (U) of the original 
groups versus 33% (T) and 27% (U) of attritees. Volunteers age 41-50 tended 
to be under-represented in the attrition population. Originally they accounted 
for 21% and 17% of the trained and untrained groups, respectively, while they • 
accounted for 12% (T) and 13% (U) of attritees. 

Occupation 

4/ 

Table 6.4 reinforces the point about hic,h attrition among college students. 
It indicates that 61% of the student volunteers dropped out as compared to only 
3 3% of the volunteers who were homemakers. The homemakers category was 
least affected by attrition. 

Figure 6.3 indicates how much each occupational group contributed to 
total attrition. Comparing Figure 6.3 with the original occupational distribution 

4/ 

^ Volunteers were allowed to choose more than one occupational category, so 
there is overlap. 
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. .y TABLE 6.4 

RATE OF ATTRITION FOR EACH OCCUPATIONAL 
CATEGORY 



Occupation 


Before 
Attrition* 


Attritees 


Student 


150 


91 (61%) ^ 


Homemaker 


237 


78 (33%) \ 

'\ 


Retired 


37 


11 (30%) 


Part-time 
employed 


67 


\ 

3 4 (51%) 

1 


Full-time 
employed 


19 


9 (47%) 


* Original number of recruited volunteers by occupational 
category. Some volunteers put themselves in more than 
one category when they registered for Upswing. Any 
attritees who did so are counted in all occupational 
categories they claimed. 
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Volume I, Figure 3*7, page 3-19), it is evident that the rates of attrition for 
students and homemakers are not proportional to the incidence of these groups 
in the original population. Twenty-eight percent of the original trained popula- 
tion were students; 48% of the original untrained population were students 
(from Figure 3.7, Volume I.) However, trained and untrained student volun- 
teers contributed 42% and 60%, respectively, to attrition. The reverse trend is 
shown for homemakers, who made up 65% and 51% of the original trained and 
untrained populations, respectively. Homemakers contributed 51% (T) and 40% 
(U) to attrition. The other occupational groups are represented in the attrition 
population to roughly the same extent that they were represented in the original 
population. The figure also clearly indicates that the difference between trained 
and untrained volunteer attrition (20% higher rate for the latter group) resulted 
from student attrition. 

Table 6.5 shows a by-city breakdown of trained and untrained attritees 
in each occupational category. The important point to be made from this table 
is that the higher overall incidence of attrition among untrained volunteers can 
be attributed to higher attrition among untrained than among trained student 
volunteers in Denver and Oxford, although more untrained student volunteers 
dropped out in the other two cities as well. 

Previous Training and Tutoring Experience of Volunteer Attritees 

Previous training and expeaence were examined by training status of 
attritee. It was thought that lack of either might handicap volunteers who did 
not receive Upswing training more than those who did. 

Previous training in child development did not keep volunteers from 
leaving the project. In fact, the data brings up the possibility that such train- 
ing might have contributed to attrition. Figure 6.4 indicates that volunteers 
who had such training before their participation in Upswing tended to drop out 
of the project slightly more often than those who did not have it; 49% of the 

trained and 46% of the untrained volunteers who dropped had no previous 
1 • . 
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Trained 
Untrained 



100p 
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50 



40 - 



30 - 



20 



10 



49% 



41% 



37% 



46% 



Volunteers With Previous 
Training In Child 
Development 



Volunteers With No Previous 
Training in Child Development 



FIGURE 6.4. COMPARISON OF ATTRITION RATE OF TRAINED AND 
UNTRAINED VOLUNTEERS V/HO HAD PREVIOUS TRAINING 
IN CHILD DEVELOPMENT WITH VOLUNTEERS 
WHO HAD NO PREVIOUS TRAINING, 
ALL CITIES 
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training, while 41% of the trained and 3 7% of the untrained did. Ten percent 
of the trained attritees and 17% of the untrained did not answer the question 
about previous training in child development on the registration form. 

Comparing Figure 6.4 to Figure 3,9 in Volume I (page 3-26 J one sees 
that in terms of trained and untrained volunteers with and without previous 
training, the attrition group differed somewhat from the original population. 
However, there were proportionally more volunteers with previous training among 
attritees than in the original population and proportionally fewer volunteers with 
no previous training among attritees than in the original population. ORI believes 
that these findings are attributable to the number of college student attritees, 
many of whom were education majors and therefore had previous training in child ^ 
development. 

Neither do the data prove that previous relevant experience v/as im- 
portant in keeping volunteers in the project. From Figure 6.5, about half of 
the untrained attritees had experience working with children with learning dif- 
ficulties and half did not. Thirty-six percent of the trained volunteers lacked 
such experience. These percentages are almost identical to the percentages 
of inexperienced T and U volunteers who registered for Upswing, as given in 
Volume I, Figure 3.10 (page 3-27.)" Comparison of the two illustrations shows, 
further, that the volunteers with each type of experience (former teacher aides, 
for example) were about equally represented in the original and the attrition 
populations. 
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VII. CONCLUSIONS AND RECOMMENDATIONS 

DID UPSWING TUTORING 'WORK? 

ORI believes that the answer to this question is a definite but 
qualified yes. The tutored children, as a group, clearly made greater gains 
in reading than the control group according to the best objective measure of 
reading skills available, in ORI's opinion— the WRA.T. Still the amount of 
difference was not radical. Figure 7.1 gives a view of the relative rates of 
progress in tested reading achievement of the tutored and untutored children. 

Based on volunteer assessments, ths tutored children made substantially 
greater improvement in oral language skills than in reading. Unfortunately we 
do not have an objective measure or comparison data on the control children. 
It would seem reasonable, however, that a one-to-one tutoring situation 
would offer a significant opportunity for improving such skills. 

Volunteer and teacher assessments also pointed to a very high rate of 
self-esteem problems among tutored children. Their final judgments suggested 
that boosting children's self-esteem was an important contribution of tutoring. 
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*Testing continued through January in some cities; thus 
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extent that classroom instruction and tutoring (for the 
experimental children) increased the scores of the children wh 
children who were tested late. 



FIGURE- 7-1. RATE OF PROGRESS IN READING AS MEASURED 
BYWRAT: TUTORED VERSUS CONTROL CHILDREN 
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None of the groups — neither of the tutored groups nor the control 
group— showed im'^roved visual-motor integration skills on an objective test 
administered at the beginning and end of tutoring. 

Unfortunately we could not gather comparison data on the control 
children for all of these variables. The data we do have, however, show 
that the tutored and control groups were qL',te homogeneous at the beginning 
of tutoring (in reading proficiency, visual-motor coordination, and IQ) • Thus 
ORI would say that the Upswing children began the year with a cluster of 
difficulties related to potential reading difficulty and other problems in school: 
poor psychomotor control; underdeveloped oral language skills; and, especially^ 
low self-esteem; although the IQ test showed that they had potential for at 
least average functioning. 

It appears that because of their young age, this cluster of difficulties 
was not yet impinging on their reading skills to any great extent, since all 
group means were in the low-average range of performance. The noted problems 
did appear to impact teachers' (and volunteers) assessments of reading 
performance. It was interesting to find that even at the end of the year, the 
adult observers tended to rate the Upswing children* s reading skills lower 
than did the objective test. 

Tutoring was successful in helping children improve their reading 
skills to the moderate extent described in Figure 7, 1. It was evidently even 
more successful in resolving or reducing some of the associated difficultif^^s 
demonstrated by the children at the beginning of the year. One cannot know 
if the rates of progress suggested in Figure 7.1 will continue over future years. 
If so, the children tutored in the first year of Upswing would move farther and 
farther ahead of the control children, although at a slow rate. If the language 
and self-esteem difficulties discussed previously are as important as we 
believe they are, and if these difficulties are present and not moderated in the 
control children, their curve in the figure will sooner or later show a downward 
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trend. In the second year of Upswing, ORI is "following" all of the children 
through their cumulative school records and endpof-year tests, to determine 
what changes occur in the hypothetical curves of Figure 7.1. 

An extremely important finding of the first-year evaluation is that the 
kind of training given in the first year of Upswing did nothing to promote more 
effective tutoring. The training model was one of heavy preparation before 
tutoring began, with some inservice sessions after a few /months with the 
children. This is a commonly used model. The data suggest that it is quite 
possible that training tutors is a waste, although it seems clear that some form 
of guidance and support over the tutoring period is essential. ORI would pre-- 
fer to reserve judgment on the training question until the second-year project 
designs and training approaches can be evaluated. 

The costs of the first year of Upswing were inflated by tasks required 
for the evaluation efforL . Even so, t^he cost of an untrained volunteer was 
minimal; and very much lower than the cost of a trained volunteer. Yet trained 
and untrained evidently had the same impact on children. If this finding holds 
after the evaluation of the second year, one-to-one tutoring by volunteers 
would indeed be an inexpensive way of helping children who have learning 
difficulties . 

Another finding that points to important cost savings is that it seems 
unnecessary to buy expensive materials for tutoring. The DISTAR and Peabody 
kits were far from fully utilized in the first year of Upswing. It appears that 
volunteers prefer to use a greater variety of more commonplace materials such 
as games and library books , art supplies, etc., many of which can be made 
by the volunteers or obtained in the schools (this also represents cost, of 
course, but not as great a cost as a supply of packaged instructional | 
"programs"). 
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ORI has already given most of its recommendations to USOE and the 
individual city directors. The program recommendations included, most im- 
portantly, that the training should be shifted to predominantly inservice for- 
mat; that volunteers felt the need for more help with specific problem-solving 
and often did not find generalized training especially useful; that a greater 
variety of less expensive materials be suggested or supplied for the tutors. 

As for the evaluation process, ORI has urged that a measure of sell- 
esteem be included in the test battery and that all testing be completed earlier 
in the year,, within a single month. The Metropolitan Achievement Test Series 
was found to be inappropriate for children with learning difficulties (and we 
believe for first-grade children in general) and has been dropped frorr^the 
Upswing battery. 

In the area of data collection, we would recommend that question- 
naires not be used to collect information from parents in a study of this kind; 
family background data can be obtained from available tests, as is being done 
in the second year of the project. Although we got good response to teacher 
and volunteer questionnaires (with great effort), the interviews with volunteers, 
children, and teachers proved perhaps more valuable in helping the study team 
understand the dynamics of the project. ORI believes that such understanding 
is essential to intelligent evaluation and would encourage others to include 
interviewing among their data collection procedures. We found that people 
who resented questionnaires were quite forthright and willing to respond to 
an interviewer.. 

ORI also feels strongly that feedback based on the data gathered by 
an outside evaluator goes a long way in ensuring the acceptance of an evalua- 
tion effort. We recommend a relationship of open communication among all 
parties Involved. 
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Appendix 
Evaluation Questionnaires 




jIVOLUNTEER 
REGISTRATION FORM 



Name — 
Address 



Zip 



Phone 



University of Ci \natti 
and 

Cincinnatti Public Schools 



2 

C 



O 



< 
a: 

O 

CO- 



< 



o 



a: 
O 



< 
O 



8 

O 



ERiC 



1 . Are you able to spend 1 hours twice a week doing volunteer tutorinf ? 

1. YesD 2. No □ 

2. Are you available to attend the SO hour volunteer training course? 

1. YesD 2. No □ 

3. Are you wriling to remain with the project for one school year? 

; 1. YesD 2. No □ 

4. Check the time pe' ods in the school day when you would be available to tutor. 



Time 


M 


T 


W 


T 


F 


Morning 












Afterncon 













CONFIDENT! A L INFORMA TION FOR PROJECT UPSWING USE ONL Y 

Note: The information below is needed to benefit future Upswing 

projects. Individual names will not be used in tabulating results. 
Nevertheless . should you object to answering any particular 
item, please feel free to omit it. 



Check one: 

1. Under 21 □ 

2. 21-25 □ 

3. 26-30 □ 

4. 31-40 □ 

5. 41-50 □ 

6. 51-60 a 

7. Over 60 G 



ir < 
< b 



6. 1. Male □ 

2. Female □ 



7. 1. Single □ 

2. Married □ 

3. Separated □ 

4. Divorced □ 

5. Widowed □ 



8. a. Are you retired? 1. Yes 0 2. No □ 

b. Are you a student? 1. YesD 2. No □ 

c. Are you a homemaker (not employed full-time outside the home}? 
, 1. YesD 2. NoD 

9. a. Are you employed full-time? I.YesQ 2. No □ 

b. Are you employed part-time? 1 . Yes □ 2. No □ 

10. If employed, please check your occupation from the list below. 

1 . Cterical (secretary, typist, bookkeeper, sales clerk ir) 

retail store, etc.) LJ 

2. Sales (insurance, real estate, merchandise sales except sales 

clerk in retail store, etc.) D 

3. Service (babysitter, beautician, domestic, guard, bus 

driver, waitress, etc.) D 

4. Skilled or structural fp/u/nder. painter, textile, plasterer, 
mechanic etc.) D 

5. Unskilled or semiskilledf/acro/'K assembly line, laborer, etc.)-- □ 

6. Professional, technical, managerial (writer, administrator, 

librarian, teacher, proprietor of retail establishment, etc.) D 

7. Farming, fishery, forestry □ 

8. Other occupation □ 



Please check the occupation of your spouse from list below. 
(If not married check box 9) 

1. Clerical (secretary, typist, bookkeeper, sales clerk ,n 

retail store, etc.} □ 

2. Sales insurance, real esxaxe, merchandise sa/es except cales 

clerk in retail store, etc.) □ 

3. Service (habysitter, beautician, domestic, guard, bus 

driver, waitress, etc.) □ 

4. Skilled or structural (plumber, painter, textile, plasterer, 
mechanic, etc.) □ 

5. Unskilled or semisk\\\e6(factory assembly line, laborer, etc.).. □ 

6. Professional, technical, managerial (writer, administrator, 
librarian, teacher, proprietor of retail esttiblishment, etc.) D 

7. Farming, fishery, forestry □ 

8. Other occupation (student, retired, etc.) □ 

9. Does not apply/Not Married □ 



< 

u 

Q 



O 



12. How many children do you have? 

a. Age 0-5 years 

b. Age 6-10 years 

c. Age 11-15 years 

d. Age over 1 5 years 

e. Total number of children — 

13 b. Check the highest level of school you completed. (Check one) 

1 . 8th gratJe or less □ 

2. 9th 10th grade □ 

3- 1 1th • 12th but not gfaduated □ 

4. Htgh school graduate □ 

5. 1 - 2 years of college □ 

6. 3 - 4 years of college buc not graduated □ 

7. College graduate (e.g.. 8. A.. 8.S.) □ 

8. Attended graduate school □ 

9. Earned advanced degree (e.g.. M.A., Ph. o.i □ 

13 b. If you attended college, what was your area of concentration? 



, Check the highest level of school completed by your spouse: 

nor married check box 0) 

1 . 8th grade or less □ 

2. 9th - 10th Grade : □ 

3. 1 1th - 12th but not graduated □ 

4. High school graduate □ 

5. 1 - 2 years of college □ 

6. 3 - 4 years of college but not graduated □ 

7. College graduate (e.g.. B.A., B.S.I : □ 

8. Attended graduate school □ 

9. Earned advanced degree (e.g.. M.A., Ph. O.) □ 

0. Does not apply/Not married □ 



15. Please put a check niark beside the closest estimate of your family's 
annual income: 

■ l.S 1.499 or below □ 

2. S 1,500 - 2,999 □ 

3. S 3,000 - 4,999 □ 

4. S 5,000 - 6.999 □ 

5. S 7.000 - ^.999 □ 

6. S 10.000- 12.999 □ 

7. S 13.000- 17,999 □ 

8. S 18,000 - 2A.999 □ 

9. S 25,000 and above □ 



1 6. Have you had any previous tutoring/teaching experience? 

(Check all that apply) 

1. No □ 

2. Yes. I have been a volunteer tutor □ 

3. Yes. I have been a paid tutor □ 

4. Yes, I have been a teacher aide □ 

5. Yes. I have been a teacher □ 

17. Have you had any formal training in child development? 

1. Yes □ 2. No □ 

18. Do you have any knowledge of, or experience with, children 

with special problems (e.g., learning problems, physical or mental 
handicaps, etc.)? 

(Check all that apply) 

1. No □ 

2. Yes. I have had some formiil training in the area of 

3. Yes. I have a child with learning problems in my family □ 

4. Yes, friends have a child with learning problems □ 

5. Yes. I have worked with children with learning problems □ 

6. Yes. 1 have worked with children with other types 
of mental or physical impairments (e.g., handicapped, 

retarded, etc.) i □ 
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O PROJECT 
^UPSWING 

^RENT 
RrGISTRATION FORM 



Name ^ 
Address 



Zip 



Phone 



San Francisco Unified School District 
in Cooperation with 
San Francisco State College 
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. CONFIOENTIA L IN FORMA TION FOR PROJECT UPSWING USE ONL Y 

Note: The information below is needed to benefit future Upswing 

projects. Individual names will not be used in tabulating results. 
Nevertheless, should you object to answering any particular 
item, please feel free to omit it. 



1. Child's Name 



2. Teacher . 



^. School 



4. Birthdate _ 



_Boy □ Girl □ 



5. Attended kindegarten? .'...LYes D 2. No □ 

6. Attended nursery school? 1. Yes □ 2. No □ 

7. Which of the following would best describe your child's attitude toward school 
in the first grade? 

1. Enthusiastic □ 

2. Favorable □ 

3. Indifferent □ 

4. Slightly negative □ 

5. Completely negative — does not want to attend □ 

0. Don't know □ 

8. Does he/she like to participate in group activities at school? 

1. Yes □ 2. No □ 3. Don't know □ 

9. Does he<she get along well with other children in his/her age group?fChecfc one! 

1 . Almost always □ 

2. Usually □ 

3. Only sometimes □ 

4. Not often □ 

5. Hardly ever □ 

0. Don't know □ 

10. Does he/she ha'fe regular playmates in the neighborhood in his/her own age 
group? 

1. No □ 

2. Only one □ 

3. Two □ 

4. A small group of friends □ 

5. Many □ 

6. No other children nearby □ 

0. Dont't know □ 



1 1 . How many children do you have? 

a. Age 0-5 years 

b. Age 6-10 years 

c. Age 1 * -15 years 

d. Age over 1 5 years 

e. Total number of children .... 



12. What is the total number of adults living in the home? (include parents, 

children 21 and over, grandparents, boarders, friends, etc) , . . . . 

fbtal 

13. Marital Status of child's parents: (check one) 

1. Single □ 

2. fVlarried □ 

3. Separated □ 

4. Divorced □ 

5. Widowed □ 

14. a. Is any language other than English spoken in the home? 

1. YesD 2. 

b. If yes, what language is it? 



NoD 
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15 What Is vour relationship to the child? 

1 Mother D 

2. Fathei □ 

3. Steo mother D 

4. Step-father □ 

5. Grandmother ^ 

6. Grandfather C 

7. Aunt/Uncle D 

8. Other relative □ 

9. Liignl guardian ^ 

0. Other □ 

16. Check highest education level reached by child's father or male o jardian: 

1 . 8th grade or less □ 

2. 9th-10th grade □ 

3. 1 1 th-1 2th gradv butnot graduated Q 

4. High school graduate □ 

5. 1 -2 years of college □ 

6. 3-4 years of college but not graduated □ 

7. College graduate (e.g., B.A.. B.S.) □ 

8. Attended graduate school □ 

9. Advanced degree (e.g., M.A., PhD., etc.) □ 

0. Don't know □ 

1 7. Check highest education level reached by child's mother or female guardian: 

1 . 8th grade or less □ 

2. 9th- 10th grade □ 

3. 1 1 th-1 2th grade but not graduated 

4. High school graduate □ 

5. 1-2 years College □ 

6. 3-4 years of college but not graduated □ 

7. College graduate (e.g.. B.A., B.S.) □ 

8. Attended graduate school D 

9 Advanced degree (e.g., M.A., PhD., etc.l Q 

0. Don't know □ 



18. Please check box beside closest estimate of your annual family income: 

1. S 1.499 or below □ 

2. S 1,5G0 ~ 2,999 □ 

3. S 3,000 - 4.999 □ 

4. S 5,000 - 6.999 □ 

5. S 7,000 - 9,999 Q 

6. S 10.000 -12.999 □ 

7. S 13,000 -17,999 □ 

8. S 18.000 -24,999 □ 

9. S 25,000 and above □ 



19. Will you approve the individual testing required by Project Upswing so that 
the teacher may plan practice work tailored to the needs of your child? .... 
LVesD 2. NoD 

20. Are you willing to attend occasional meetings with your child's teacher 

and/or volunteer during the course of the school year? 

1. YesD 2. No □ 

21 . Further comments about you' vhild or the volunteer program: 
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PROJECT UPSWING 



VOLUNTEER FIRST IMPRESSIONS 



OMB No. : 51^5-7/049 
Expiration Date: 6/30/72 



NAME: 



CH/LD'S NAME: 
SCHOOL 



CITY 



ZIP 



Instructions: For each item below, check the 

box after the phrase or statement 
which comes closest to your own 
opinion or experience as a volunteer. 
Please- CHECK only ONE box per 
question. Space is provided for 
comments on most questions. 



CONFIDENTIAL INFORMATION FOR 
PROJECT UPSWING USE ONLY 

Please do not consult with other volunteers when 
answering these questions. Your frank opinions are 
needed and your responses will be kept in complete 
confidcMice. No names vi/ill be used when responses 
are tabulated. 



1. My first impression is that Project Upswing 

will: (check one) 

a. Be beneficial to most of the 

children participating □ 

b. Be beneficial to some of the 

chiidren participating □ 

c. Not be beneficial to any of the 
children participating □ 

2. My first impression Is that Project Upswing 

will probably: (check one) 

a. Produce major improvements in 

the progress made by my pupil □ 

b. Produce limited improvements in 

the progress made by my pupil □ 

c. Have no effect on the progress 

made by my pupil □ 

d. Interfere with the progress 

normally made by my pupil □ 

Comments: 



3. I feel that the training or orientation given 
to me as a volunteer is: (chtck one} 

a. Excellent □ 

b. Adequate □ 

c. I nadequate □ 

Comments: 



4. I feel that: (check one) 

a. I have mo.e training than I need 
in the methods and materials ! must 

use as a tutor □ 

b. i am adequately prepared to use 
the methods and materials available 

for tutoring □ 

c. I n*eed more training in the methods 
and n!=iterials I must use as a tutor □ 

Comments: 



5. \ feel that the teaching methods and materials 
I use as a volunteer will be: (check one', 

a. Highly effective □ 

b. Effective □ 

c. Ineffective □ 

Comments: . 



6. Check one: 

a. I have done extensive outside reading 
about children with learning problems 

since joining Project Upswing □ 

b. I have done a little outside reading 
about children with leavr\ir\g problems 

since joining Project Upswing □ 

c. I have not hacTa chance to do any 
outside reading about children v^/ith learning 
problems since joining Project Upswing □ 

d. I have not desired to do any outside 
reading about children with learning 
problems since joining Project Upswing □ 

Comments: ^ 



7. i feel that preparing for tutoring sessions 

Is: (check one) 

a. A useful and interesting part of 
volunteering □ 

b. Necessary but tedious work □ 

c. Time-consuming and unnecessary (H 

Comments: 



8. I find the task of tutoring my pupils is: 

a. More difficult than I had expected □ 

b. As challenging as I had expected □ 

c. Easier than I had expected □ 

Comments: , 



12. Check one: 

a. ) am satisfied with my role as 

i\n Upswing volunteer □ 

b. I am satisfied with certain 
aspects of Project Upswing, but 
dissatisfied with others □ 

c. I regret having committed myself 

to Project Upswing □ 

Comments: 



13, In this space please note any problems you 
hiwe encountered or write any comments you 
have that may be useful to fu^Mre Upswing 
programs. 

Comments: 



9. My pupil's first lesponse to me was: 



a. Willing cooperation □ 

b. Hesitant cooperation □ 

c. Neutral □ 

d. Confused □ 

e. Hostile □ 



Comments: 



10. I feel that the teacher: (check one) 

a. Welcomes my assistance □ 

b. Is neutral about my assistance □ 

c. Resents my assistance □ 

d. I don't know how the teacher 

feels about my assistance □ 

Comments: 



11. Check one: 

a. I would prefer more guidance 

from the teacher □ 

b. The teacher i work with gives 

me adequate guidance □ 

c. ( would prefer less guidance 

from the teacher [J 

d. I do not need any assistance 

from the teacher □ 

Comments: 



1 
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PROJECT UPSWING 



TEACHER FIRST IMPRESSIONS 



CMBNo.: 51-S-7/049 
Expiration Date: 6/30/72 



NAME: 



\ 



SCHOOL: 
CITY: 



\ 



ZIP: 



Instructions: This questionnaire has been prepared 

to find out what feelings you have 
about ,the special attention your 
students are receiving in Project Upswing. 
Please select the answer that most 
reflects your feelings and place 
a check mark in the box after your 
answer, Space is provided for 
comnnents on most questions'. 



CONFIDENTIAL INFORMATION FOR 
PROJECT UPSWING USE ONLY 

Please do not consult with other teachers when 
answering tliese questions. Your *rank opinions are 
needed and your responses will be kept in complete 
confidence. No nannes will be used when responses 
are tabulated. 



1. My first Impression is that Project Upswing 
will: {check one) 

a. Be beneficial to most of tfie 

children participating □ 

b. Be l)eneficial to some of the 

children participating □ 

c. Not be beneficial to any of the , 
children participating □ 

Comments: 



4. Parents of children in the Upswing Program: 

(check one) 

a. Should often help their children 

with school work at home □ 

b. Should not help their children 

with school work at home □ 

c. Should occasionally help their 

children with school work at home □ 

Comments; '_ 



2. The training given to volunteers seems to have 
been: (chock ona: 

a. Excellent □ 

b. Adequate □ 

c. Inadequate □ 

d. I have no knowledge of the 

training given to volunteers □ 

Comments: '. 



3. I feel that: (check one) 

a. Most teachers prefer to handle 

their students alone □ 

b. Most teachers welcome 

volunteer aides □ 

Comments: 



5. Check one: 

a. - I would like to have Upswing 
volunteers working with my class 

next year L 

b. I would prefer not to have Upswing 
volunteers working with my class 

next year I 

c. I am undecided about having Upswing 
volunteers in my class next year L 

Comments: ^ 
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6. In the space below please indicate all the regular class activities each Upswing pupil misses during his tutoring 
sessions with his volunteer (e.g., reading, recess, art, etc.). 



Child's Name 



Class Activities Missed 



1. 

2. 
3. 
4.. 
5., 



7, Please indicate any changes you have noticed in the reading and general behavior of the Upswing pupils since 
they began working with the tutors. 



Child's Name 



1. 



Reading Ability 

Improved □ 

Remained the same 
Declined □ 



2. 



4. 



5.. 



Improved □ 

Remained the same 
Declined □ 

ImprovPCj n 

Remained the same 
Declined □ 

Imoroved □ 

Remained the same 
Declined □ 

Improved Q] 

Remained the same 
Declined LJ 



Behavior/Attitude 
Toward School 

Improved ['} 

Remained the same... □ 
Declined □ 

Improved □ 

Remamed the same... □ 
Declined □ 

Improved □ 

Remained the same... □ 
Declined □ 

Improved □ 

Remained the same.,, □ 
Declined □ 

Improved CI 

Remained the same _ □ 
Declined □ 



8. How do you think the Upswing children feel about their volunteer? (check one) 



Child's Name 



1. 

2. 
3. 
4. 
5. 



Likes 
Volunteer 

□ ... 

□ ... 

□ ... 

□ ... 

□ ... 



I>eems Neutral 
About 
Volunteer 

□ 

□ 

□ 

□ 

□ 



Does Not 

Like 
Volunteer 

□ ... 

□ ... 

□ ... 

□ ... 

n ' :r. 



Don't Know How 

Child Feels 
About Volunteer 

n 

□ 

□ 

□ 

□ 



9. In this space please note any problems you may have ^encountered regarding Project Upswing or write any 
comments you have that might be useful to future i oswing programs. 
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PROJECT UPSWING 



PARENT FIRST IMPRESSIONS 



OMB rio. 51-S-7/049 
Expiration Date. 6/30/72 



PARENT'S NAME: 
CHILD'S NAME_ 
SCHOOL ' 



CITY 



ZIP 



Instructions: This questionnaire has been prepared 

to find out what feelings you have 
about the special attention your 
child is receiving in Project Upswing. 
Please select \he answer that most 
reflects you'^ feeiings tjnd place 
a check mark in the box after your 
answer. Space is provided for 
comments on most questions. 



CONFIDENTIAL INFORMATION FOR 
PROJECT UPSWING USE ONLY 

Please do not consult with other parents when 
cinsvv/ering these questions. Your frank ofjuiions iuo 
fieeded and vour responses will be kept in ccmpUiiL* . 
confid:;nce. No names will he used when responses 
are tabulated. 



1. Your relationship to the child is; 

a. Mother □ 

b. Father □ 

c. Stepparent r. □ 

d. Foster parent □ 

e. Guardian □ 

f. Other (specify) □ 



2a. Were you able to attend the Project Upswing 
parent orientation session? 
Yes .... (Answer 2b) 
No (Skip to question 3) 

2b. Did you feel that the orientation session given 
to the parents was: 

a. Excellent □ 

b. Adequate □ 

c. Inadequate □ 

Comments: ^ 



3. Check one: 

a. ) teel that Project Upswing 

probably will benefit my child □ 

b. I feel that Project Upswing 

probably will not benefit my child □ 

c. I have no idea wnat effect 
Project Upswing will have on mV 

child n 

Comments: , 



4- How did you feel about Project Upswing 
selecting your child for special attention? 

(check one) 

a. I am pleased to have my chtid 
involved in Project Upswing i i 

b. I have no opinion about my 
child's participation in Project 

Upswing : \ 

c. I am not pleased that niy chiUJ 

is participating in Project Upswing : | 

Comments: 



5. Please indicate whether you agree or disagree 
with each of the following statements by 
placing a check in the appropriate box. 

a. The only person who should todch my 
child to read is the teach(M" 

Agree 1 

Disagree 1 

b. It is bettei for pdients not to 
discusb classwofk with the child who is 
having difficuky wifh school work 

Agree ( 

Disagree [ 

c. Parents whose children iire having ■ 
difficulty with first grade work should 
work with them regularly at ho.me 

Agree ^ 1 

Disagree I 

Comments: 
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6. How do you think your child feels about receiving 
volunteer assistance under Project Upswing? 

(check one) 

a. nc dCciiiD lu CMjuy uic bpcuiai 

attention □ 

b. He seems indifferent □ 


9, In this space please ncte any problems you may 
have encountered regarding Project Upswing or 
write any comments you have that might be 
useful to future Upswing programs. 


c. He seems unhappy or disturbed 

by the special attention □ 

d. He has not expressed his feelings 

about it □ 

rnmmpntQ' 


; '■ 


















7. How do you think you " child feeis about his 
volunteer? (check one) 

a He likes his volunteer LJ 

b. He does not like his volunteer □ 




c. 1 do not know how he feels about 

»nis volunteer □ 




nnmmpnU! 





















8. Which of the following would best describe your 
child's attitude toward school since he began 
working with his Project Upswing volunteer? 

(check one) 

a, Enthusia" ''^ □ 

b. Favorable □ 




c InHiffprPnt 1 1 

d. Slightly negative □ 

e. Completely i.egative □ 

f. 1 don't know □ 

Comments: 








•I 












/ 
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PROJECT UPSWING 



FINAL PROGRESS REPORT FROM VOLUNTEER 



OMB No.: 51-S-72024 
Expiration Date:6/30/72 



Volunteer's Name: 

Child's Name: 

School: 



City:_ 



CONFIDENTIAL INFORMATION FOR 
PROJECT UPSWING USE ONLY 

Please do not consult with other volunteers when answering these 
questions. Your frank opinions are needed. No names will be used 
when responses are tabulated. If there is any question you woufd 
rather not answer, feel free to skip it. However please make every 
effort to answer as many questions as possible.' 
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1. In your opinion, what overall Impact has Project 
Upswing had on the progress of the child you tutor? 

(check one) 

a. I feel that Upswing has resulted in major 
improvements In the progress of my pupil . . [ ] 

b. \ feel that Upswing has resulted in limited 
improvements fn the progress of my pupil ..[ ] 

c. I feel that Upswing has had no effect on the 
progress of my pupil ( ] 

d. 1 don't know [ ] 

Comments: 



2. What is the child's usual response to tutoring 
activities? f^f/zf'cA: one) 

a. Negative [ 1 

b. Neutral [ 1 

c. Eager [ 1 

Comments: 



3. Which best describes the child's usual response to 
you at the beginning of tutoring and wovil (please 
check one for each time period) 

At the 

Beginning Now 

a. Willing cooperation [ 

b. Hesitant cooperation [ 

c. Neutral [ 

d. Confuted [ ] [ ] 

e. Hostile 



Comments:! 

/ 



4. HcjV does the child seem to feel about missing class 
activities for the tutoring se^\ox\l ( check one) 

a. Considers it a special treat 

b. Willing but not enthusiastic i 

c. Reluctant to miss class activities . 

d. Embarassed to be singled out 

e. I don't know 



Com. lents: . 



5. Consider all the time you have spent tutoring the 
child as 100%. Please estimate how much time you 
and the child have spent on each of the following 
activities since tutoring began, (write in the 
approximate percentage of time spent on each 
activity. If you have not spcfit any time on a certain 
activitv, please write in '7A Remember, total time 

Percent of 

Activity Time Spent 

a. DISTAR [ ]% 

b. Peabody [ ]% 

c. Writing/telling stories [ j% 

d. Unstructured verbal expression (taking walks 
aroutid school, schoolyard, etc.) , . . [ ]% 

e. Practice on classwork in reading (reader^ read i fig 
workbook, etc.) [ ] % 

f. Practice on other skills or class assignments 
suggested by the teacher [ ] % 

g . W o r d /a I ph a be t d r i 1 1 f e.g, , using flash < 'ards , W( )j d 
strips, felt board, blocks, tracing afjd othrr types 
of word j letter learning by touch) ... [ ] % 

h. Games ■ [ 1% 

i. Library books . I ]% 

j . M o t o r a c t i V i t i e s /'/?/n w ical exercise) [ I % 
k . 0 1 h e r lease sp ecif} ' ) 



_[ ]% 

Total 100% , 

6. Have you noticed any change in the child's 
confidence and/or self esteem since tutoring began? 

(check one) 

a. Child seems to ,, have made major gains in 
confidence/self esteem ( 1 

b. Child seems to have made moderate gains in 
confidence/self esteem [ ] 

c. Child seems to have remained at about his initial 
level of confidence/self esteen?, but this never 
appeared to be a problem area for him [ ] 

d. Child seems to have remained at about his initial 
level, but needs greater confidence/self esteem [ ] 

e. Child seems to have lost some confidence/self 
esteem *. . . [ 1 

Comments: 



7. 



Have you noticed any change in the child's 
willingness to express himself orally? (check one) 

a. Yes, there has been a major improvement . . I ] 

b. Yes, there has been moderate improvement ] 

c. No, he has expressed himself freely throughout 
tutoring * [ ] 

d. No, I have not noticed any change, but I feel 
there is a need for growth in this area [ ] 

e. Yes, the child seems to have withdrawn . . . . [ ] 



Comments; 



8. Have you noticed any change in the child's ability 
to pay attention since tutoring began? ( check one) 

a. The child's ability to pay attention has decreased 

[ ] 

b. I have not noticed any change, but I feel 
improvement is needed [ 1 

c. Poor attention was never a problem for this child 
... ■ [ I 

d. The child has made moderate gains in ability to 
pay attention ". . . [• ] 

e. The child has made major gains in ability to pay 
attention .[ ] 

Comments: 



Have you noticed any change in hyperactive 
behavior since tutoring b&^dinl ( check one) 

a. Hyperactivity has increased [ ] 

b. I have not noticed any change , but I feel 
improvement is needed [ ] 

c. The child was never hyperactive [ ] 

d. The child is somewhat Irss hyperactive . . . . [ ] 

e. The child is considerably less hyperactive .. . [ 1 



Comments: . 



10. Has there been a language barrier between you and 
the child? (if yes, please briefly describe in 
comments space J 

a. Yes [ ] 

b. No L ] 



Comments: . 



11. On the rating scale below, show any changes you 
have observed in the child's reading and language 
performance, (please circle one rating for each skill 
area j 

RATING SCALE 

NA — Not applicable to child at this stage of 
development; we have not worked on it 

—1 — Child's level of skill in this area seems 
lower than it was in November 

0 — No change observed 

+1 ~ Some improvement observed 

+2 — Major improvement observed 



SkiU Area 


Not Applicable 

Lower 

No Change 

Some Improvement 

Major /rnprovement 


a. Spealcing 
vocabulary 


NA -1 G +1+2 


b. Ability to 
express ideas 
clearly 


NA -t 0 +1 +2 


c. Understanding 
through listen- 
ing {understands 
directions, mean- 
ings of stories 
read to him, etc.) 


NA -1 a +1 +2 


d. Ability to sound 
out new words 


NA -1 0 +1 +2 


e. Understanding 
what he reads 


NA -1 0 +1 +2 


f. Reading with 
expression 


NA -1 0 +1 +2 



12. Whe'-e do you usually tutor the child (for example, 
empty classroom, cafeteria, hall) 7 



13. Do you feel that the tutoring environment is 
adequate /'/.i'., welllighied, comfortable, quiet, etc.)? 

a. Yes [ ] 

b. No [ 1 



If no, list problems: 



14. In your opinion, how much time should Upswing 
x'olunteers spend tutoring their pupils? f your a tiswer 
will h e I p. ',' A ifi plan n i n g n ex t y ear 's 
program ) hours/week. 



Comments: . 



15 



Please estimate the average amount of time you 
spend preparing for □ tutoring session, (check onej 

a. I do not have the time for special preparation 1 ] 

b. t feel that special preparation is unnecessary ( ] 

c. 15-30 minutes per session [ ] 

d. 30 minutes— 1 hour per session 1 ] 

e. 1 —2 hours per session . . [ J 

f. More than 2 hours per session [ ] 



Comments: 



16. How often are tutoring materials available to you at 
the school when you need them? (please check one) 

a. Always 

Usually 

Sometimes 

Rarely 

Never 



b. 
c. 
d. 
e. 



Comments: (please note if there has been a change in the 
availability o f materials) 



17. I fee? that the teaching methods and materials 1 use 
as a volunteer have been: 

a. Highly effective . [ ] 

/ b. Effective [ ] 

c. Ineffective [ ] 

Comments: 



18. Who has been your primary source of guidance and 
assistance during the year? (check one) 

a. Teacher [ ] 

b. Upswing staff [ j 

c. Other voltinteer(s) [ ] 

d . Other/" please spe cify ') / / 

Comments: - . 



20. What kind(s) of guidance-assistance do you think the 
Project Upswing staff from the university should give 
(regardless of whether it has been given this year)? 



21. Did you receive any guidance from the child's 

teacher? 

a. Yes [ ] 

b. No [ ] 

22. How do you feel about teacher guidance? (check 
one) 

a. I would have preferred more teacher guidance 
from the teacher [ ] 

b. The teacher I, vv^ork with has given me adequate 
guidance [ ] 

c. I would have preferred less guidance from the 
teacher [ ] 

d. I do not need any guidance from the teacher [ ] 

Comments: 



23. Please indicate what kinds of guidance-assistance you 
would prefer to get from the teacher. (Rank the 
choices from I to 6; 1 - most important to you, 6 = 
least iinportant to you.) 

a. Discussions with teacher about child's progress 
and problem areas [ ] 

b. Discussions with teacher to coordinate activities [ 
c/ Teacher suggestions about tutoring materials to 

use [ ] 

d. Teacher help in locating tutoring materials .[ ] 

e. Regular teacher guidance in planning for tutoring 
sessions [ ] 

f. Regular assignmer^t of tutoring activities by 
teacher [ ] 

24. Are there any additional kinds of teacher aid which 
should receive a high priority? /^.s'pt'C7/vy 



19. Do you feel you have received enough guidance and 
assistance during the year ^Jor cxar?iple, help in 
' planning tutoring sessions, m getting materials, in 
specific problem-solving, etc.)? (check one) 

a. Yes [ ] 

b. No [ ] 

. Comments: 

er|c 



25. How does the child's teacher seem to feel about your 
assistance? (check one) 

a. I feci that the teacher has welcomed my 
assistance [ ] 

b. I feel that the teacher has been neutral about my 
assistance [ ] 

c. I feel that the teacher has resented my assistance 

[ I 

d. I don't know how the teacher has felt about my 
assistance [ 1 

Cfimmpnt-;- ; 



26, Please rank the importance of the following in 
helping you to be an effective Upswing tutor. 

from } to 5 in space provided; J - inosi important: 5 
- least important. ) 

a. Day-to-day experience with child i 1 

b. A close working relationship with the child's 
teacher [ ] 

c. Training in techniques and materials for tutoring 

[ ] 

d. Experience working with children in age group [ ] 

e. Previous tutoring experience [ 1 

27. Please specify any other factors that you fee! are 
important aids to effective tutoring: 



29. Has Project Upswing generally met your original 
expectations? ( check one) 

a. Yes [ ] 

b. No [ ] 

If no. please comment on your feelings: 



30. Do you think you would like to continue as an 
Upswing volunteer next yeer? ( check one) 

a. Yes [ ! 

b. No [ ] 

(If no, skip to question 32) 

31. If you would like to continue as an Upswing 
volunteer, which statement applies to you: 

a. I would not want to receive training [ 1 

b. I would want to receive training [ 1 

c. I don't know/it depends on the training ....[ ] 

Comments: 



32. If you would not like to continue as an Upswing 
volunteer, please comment on your reasons. 



28. Please indicate your feelings about each of the 
following aspects (a. — j.) of Project Upswing, using 
the scale below. 

so DOS SS 
J I I 



Strongly 
Dissatisfied 



I 

Dissatisfied Neutral Satisfied 



Strongly 
Satisfied 



Then rank the importance of each item from 1 to 10 
♦ its impact on your satisfaction with 



in terms of 
Upswing ( I 



most important, 10 = least important). 
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a. Upswing's overall 



Circle 
Attitude 



Rar^k 



approach to working 




Ratinq 




I 


m porta nee 


with children who 












have nninimal learning 














difficulties 


SD 


D 


O 


s 


SS 




b. The research 














questionnaires 


SD 


O 


O 


s 


ss 




c. The preparation for 














tutoring given by 














Upswing 


SD 


D 


o 


s 


SS 




d. The assistance given 














to ycu during the year 


SD 


D 


u 


s 


ss 




e. Overall project 














communications 


SD 


D 
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s 


SS 




f . Working vyith the 














children 


SD 


D 


o 


s 


SS 




g. Working within the 














schooJ system 


SD 


D 
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s 


SS 




h. The Knowledge you 














.have gained in your 














Upswing experiencr 


SD 


D 


0 


s 


SS 




i. PersonaUecognition for 














your contributions of 














time and effort 


SO 


D 


0 


s 


SS 




j. Upswing as an opportunity 














for community service 


SD 


D 


o 


s 


SS 





UNTRAINED VOLUNTEERS DID NOT RECEIVE THIS PAGE 



33. 'Based on your experience this year, what topics do 
you fefcf it is most important to cover in Upswing 
training? 



34. Which aspects of the preservice training given this 
year were not useful to you? (please check all that 
were not useful and explain briefly in the space 
provided) Check Exprain if checked 
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a. Orientation to project 
and the public schoots 
(including your role as 
an Upswing volunteer) 



b. Background information 
^n child devdiopment 
(including what to 
expect from a "typical" 
first grader, etc.) 



c. Diagnosing the child's 
needs 



d. Approaches to tutoring 
(including techniques 
of positive 
reinforcement) 



e. Use of Peabody 



f. Use of DISTAR 



g. Use of the language 
experience approach 



□ 



□ 



□ 



o 



□ 



□ 



h. Use of other materials 
and methods for reading 
instruction 



□ 



35. How many inservioe training sessions did you 
attend? sessions 



36. How would you rate the mservice training? /"r/zee^A' 

one) 

a. Good ......[ 1 

b. Fair { ) 

c. Poor [ ) 

37. What aspects, if any, of the inservioe training were 
particulary useful to you? (please describe in the 
space provided. If none of the inservicc training \\?as 
particularly useful to y(Hi, write *'N()ne' in the 
answer space J 



38. Which aspects, if any, of inservioe training were not 
useful to you? (please describe in the space provided. 
If you found all of the inservice training useful, write 
''None'' in the answer space.) 



39. The space below is provided for any additional 
comments you may have about your experience as a 
tutor, your pupil, or the Upswing program. 
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Has tho child shown any changes in 
amouni of hyperactive behavior since 
tutoring began? 

a Hyperactivity has increased 

b. improvement is needed but 
none has been made yet 

c. The chitd was never 
hyperactive 

d The child is somewhat less 
hyperactive 

e The child is considerably 
less hyperactive 
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Has there been any change in the 
child's ability to pay atter.tion since 
tutoring began? 

a. The child has made major 
gams in ability to pay 
attention 

b. The child has made 
rnouerate gains m ability to 
pay attention 

c. Poor attention was never a 
problem for this child 

d. There is need for 
improvement but none has 
been made yet 

e. The child's ability to pay 1 
attention has decreased ' 
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PROJECT UPSWING CHILD RECORD FORM 



Child's Name: _D.O.B.* 

Parent's Name: . 

Home Address: 



Teacher: 



Volunteer: 



Test — 


Fall 1971 


Spring 1972 




Score 


Percentile 

(If used) 


Score i Percentile 

j (If Used) 


Vision Test 










Hearing Test 










Slossen Intetligence 










Metropolitan Primer 










Burks' Behavior Rating Scale 










Wide Range Achievement 
Test-Reading 










Beery-Buktenica Visual Motor 
Integration 

Metropolitan Primary 











*Date of Birth 
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UPSWING VOLUNTEER ATTRITION REPORT 

Name of Volunteer 

i^chool 

City. 

This Volunteer was: 

Trained CD 
Untrained □ 

Date Upswing Particloation Ended (tipproximatoj 



Reason for Leaving Program (if known! 



Report Filled Out by; 



